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I.  Title  of  Project  and  Principal  Investigator 

The  California  Central  Coast  Research  Partnership;  Building  Relationships,  Partnerships 
and  Paradigms  for  University-Industry  Research  Collaboration;  Susan  C.  Opava,  Ph.D. 

II.  Summary  of  Project 

The  mission  of  the  California  Central  Coast  Research  Partnership  (C^RP)  is  to  facilitate 
the  exchange  of  technical  knowledge  and  skills  between  the  higher  education  sector  and 
the  private  sector  in  San  Luis  Obispo  County,  and  to  encourage  the  growth  of  high-tech 
companies  in  the  region,  thereby  enhancing  economic  development  and  quality  of  life. 
Since  its  inception,  the  project  has  focused  on  technologies  of  relevance  to  the 
Department  of  Defense.  The  partnership  is  a  long-term  plan  to  create  a  dynamic  and  self- 
supporting  university-industry-govemment  partnership  that  capitalizes  on  the  strengths 
and  mutual  interests  of  the  educational  and  technology-based  business  sectors.  The  plan 
recognizes  the  key  role  of  higher  education  in  preparing  a  highly  skilled  work  force  and 
transferring  new  knowledge  to  practical  uses.  The  outcomes  of  this  partnership,  when 
fully  realized,  will  be  the  creation  of  a  robust  and  self-sustaining  base  of  University 
R&D  activities;  the  development  of  existing  technology-based  businesses  and  the 
creation  of  new  ones;  and  the  generation  of  opportunities  for  job  training  and  research 
and  development  activities  for  University  and  Community  College  students  and  faculty. 

The  project  also  includes  the  construction  (with  non-DOD  funding)  of  a  technology  park 
on  the  California  Polytechnic  State  University  campus,  which  will  provide  state-of-the- 
art  space  for  private  technology  companies  engaged  in  research  and  development 
activities,  as  well  as  a  business  incubator  that  will  provide  all  of  the  support  services 
needed  by  start-up,  technology-based  companies.  The  aspect  of  the  program  supported  by 
this  ONR  grant  is  the  continued  development  of  a  strong  base  of  applied  research  at  Cal 
Poly,  through  university-govemment-industry  partnerships  designed  to  optimize  the 
application  of  the  strengths  of  each  of  these  sectors  to  problems  of  mutual  interest.  The 
management  team,  operational  since  January  ’02,  continues  to  lead  the  project  and 
develop  the  collaborative  relationships  between  the  educational  and  private  sectors  that 
are  essential  to  realizing  long-term  goals  and  securing  the  financial  base  that  will  allow 
full-scale  project  development. 

III.  Relevance  to  ONR  Objectives 

A.  Relevant  partners. 

C^RP  represents  a  coalition  of  educational  institutions,  local,  state  and  federal 
government,  and  private  businesses  that  have  worked  together  in  unprecedented  fashion 
to  advance  the  common  goals  inherent  in  the  proposed  university-industry  partnership. 
The  current  partners  in  the  project  and  their  contributions  include: 
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California  Polytechnic  State  University 

o  committed  the  land  for  the  first  building  in  the  Cal  Poly 

Technology  Park  construction  project,  valued  at  ~$1.5  million 
o  provided  assistance  in  financial  management  of  the  project 
o  contributed  $90,000  for  a  pre-feasibility  study  by  Bcchtcl 
Corporation 

o  committed  several  hundred  thousand  dollars  of  in-kind 

contributions  of  senior  management  time  and  effort  over  several 
years  and  continues  to  do  so 

o  invested  ~$1 ,000,000  in  efforts  to  raise  additional  funds  for  the 
project;  secured  sufficient  private  and  other  federal  funding  to 
construct  the  first  building  in  the  Cal  Poly  Technology  Park 
CENIC  (Corporation  for  Educational  Network  Initiatives  in  California; 
association  of  Intemct2  universities  in  CA) 

o  works  with  Cal  Poly  to  provide  high-bandwidth  internet  access  to 
support  C^RP  research  projects 
City  of  San  Luis  Obispo 

o  in  partnership  with  Cal  Poly  developed  a  carrier-neutral  fiberoptic 
ring  around  the  city  that  benefits  both  Cal  Poly  and  technology- 
based  businesses 

Housing  and  Urban  Development 

o  provided  funds  toward  construction  of  the  pilot  technology  park 
building. 

Economic  Development  Administration 

o  has  provided  funds  toward  construction  of  the  pilot  technology 
park  building. 

Efforts  arc  ongoing  to  secure  new  partners,  including: 

■  Major  corporations 

■  Small  technology-based  businesses 

B.  Relevant  R&D  focus. 

The  research  programs  that  were  supported  are  relevant  to  seven  of  the  eight  “thrust 
areas”  of  ONR’s  Code  30  Science  and  Technology  Program.  The  projects  involved  basic 
research  in  these  areas,  as  well  as  applied  research  and  development  leading  to  more 
immediate  technological  applications.  The  seven  areas  of  relevance  and  the  more  specific 
focus  areas  to  which  the  research  contributed  are  listed  below; 

Command  and  Control,  Computers,  Communication;  situational  awareness; 
communications;  knowledge  management;  computational  electromagnetics;  autonomous 
systems;  LIDAR;  data  acquisition;  satellite  constellations;  reconnaissance;  denial  of 
service  attacks. 
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Force  Protection:  post-impact/explosive  force  stability  assessment;  bio-  and  chemical- 
hazard  detection  and  mitigation;  risk/vulnerability  assessment;  new  materials;  collision 
avoidance;  autonomous  robots. 

Mine  Countermeasures:  coastal  monitoring;  lED  detection;  situational  awareness. 

Human  Performance,  Training  and  Survivability:  cognitive  performance 
enhancement;  physical  performance  enhancement;  smart  materials;  sensors;  biological 
stress  reactions;  biomarkers;  injury  repair;  improved  materials  and  processes  for  use  on 
military  bases  and  in  the  field. 

Intelligence,  Surveillance  and  Reconnaissance:  data  acquisition;  sensors;  satellite 
constellations;  autonomous  vehicles;  optical  and  radar  imaging. 

Logistics:  alternative  energy  sources;  new  materials. 

Maneuver:  advanced  design  and  materials  for  vehicles  (land  and  water). 

C.  University-industry-government  partnership. 

The  primary  focus  of  this  long-term  initiative  is  to  forge  a  strong  link  between  private 
sector  R&D  and  University  applied  research  to  speed  the  development  of  new  knowledge 
and  the  transfer  of  technology  to  the  public  and  private  sectors.  San  Luis  Obispo  has 
become  a  draw  for  technology  businesses  (with  a  heavy  concentration  of  software 
development  companies)  from  both  the  LA  Basin  and  Silicon  Valley.  For  example,  SRI 
(Stanford  Research  Institute),  International  operates  a  "software  center  of  excellence"  in 
the  city.  Lockheed-Martin  has  a  research  and  development  group  in  nearby  Santa  Maria. 
Two  local  companies  manufactured  critical  components  for  the  Mars  rovers,  and  other 
companies,  e.g.  California  Fine  Wire,  Aeromech,  and  COM  Technologies  are  suppliers  to 
the  military.  Also  located  on  the  Central  Coast  are  branches  of  two  major  biotechnology 
companies:  Promega  Biosciences  and  Santa  Cruz  Biotechnology. 

D.  University  strengths. 

Cal  Poly  is  a  State  university  that  has  achieved  national  distinction  as  a  polytechnic 
university,  with  engineering  and  computer  science  programs  ranked  among  the  very  best 
undergraduate  programs  in  the  country.  Its  strengths  have  led  it  to  orchestrate  the 
research  partnership  effort  and  the  consortium  of  partners  described  herein.  Cal  Poly  also 
has  affiliations  with  CSA  (California  Space  Alliance)  and  with  Vandenberg  Air  Force 
Base,  where  it  has  offered  an  M.S.  in  Aerospace  Engineering  by  distance  learning.  Cal 
Poly  has  the  capability  to  offer  many  more  academic  programs  by  distance  learning  to 
remote  locations.  In  particular,  through  possible  collaborative  agreements  at  cable-head 
locations  around  the  world  (including  Asia  and  Europe)  our  programs  can  be  made 
available  to  military  personnel  stationed  almost  anywhere  in  the  world. 
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Over  the  past  several  years,  the  University’s  faculty  has  been  turning  over  at  a  rate  of 
about  10%  a  year.  The  University  has  responded  to  this  opportunity  by  hiring  research- 
oriented  faculty  and  promoting  applied  research  and  development.  With  as  many  as  50- 
60  new  faculty  hires  per  year  in  the  past  six  years,  the  University  is  positioned  to 
undertake  significant  R&D  projects  for  government  and  industry.  C^RP  has  provided 
needed  support  and  infrastructure  for  these  faculty,  which  has  enabled  them  to  develop 
ongoing  research  programs  and  secure  >$7  of  competitive  funding  for  each  $  1  of  C^RP 
funding  invested  in  them. 

Cal  Poly  also  has  a  highly  qualified  student  body  with  entering  credentials  comparable  to 
students  who  attend  the  highest  ranked  campuses  of  the  University  of  California.  Our 
students  gain  valuable  experience  working  with  faculty  on  externally  sponsored  research 
projects. 

A  hallmark  of  Cal  Poly  is  its  extensive  network  of  industry  partners.  The  President’s 
Cabinet  consists  of  more  than  30  major  corporate  and  business  leaders.  Each  college,  and 
each  department  within  the  college,  has  its  own  industrial  advisory  board.  Until  recently 
these  connections  were  not  exploited  to  attract  industry-sponsored  R&D  to  campus; 
hence,  one  of  the  goals  of  the  C^RP  partnership  is  to  use  these  existing  relationships  with 
industry  to  gamer  support  for  our  R&D  efforts,  wherever  possible  in  a  three-way 
partnership  with  government  entities,  so  as  to  leverage  the  assets  of  each  partner  for  the 
benefit  of  all.  Cal  Poly’s  College  of  Agriculture,  Food  and  Environmental  Science  has 
successfully  demonstrated  this  kind  of  partnership  through  its  Agricultural  Research 
Initiative.  Through  this  initiative,  a  consortium  of  four  campuses  in  the  CSU  garnered  $5 
million  a  year  in  on-going  funding  from  the  State  of  California  to  support  agricultural 
research  of  interest  to  the  State,  with  a  pledge  to  raise  matching  funds  from  industry.  This 
State  and  private  funding  has  leveraged  additional  support  from  the  federal  government. 
Similar  new  CSU-wide  initiatives  include  the  Council  on  Ocean  Affairs,  Science  and 
Technology  (http://www.calstate.edu/coast)  and  the  Water  Resources  and  Policy 
Institute. 

As  will  be  seen  in  the  remainder  of  this  report.  Cal  Poly  has  extraordinary 
interdisciplinary  technical  assets  that  can  be  brought  to  bear  on  the  science  and 
technology  issues  of  importance  to  ONR. 

In  summary,  the  California  Central  Coast  Research  Partnership  has  taken  advantage  of  a 
confluence  of  factors,  including  existing  and  potential  relationships,  fortuitous 
technological  and  economic  developments  in  the  region,  the  particular  strengths  and 
expertise  of  the  Collaborative  Agent  Design  Research  Center  at  Cal  Poly,  and  a  meshing 
of  the  research  and  development  interests  of  the  University,  the  Office  of  Naval 
Research,  and  the  private  sector.  C^RP  is  the  vehicle  for  fully  realizing  the  benefits  of  the 
common  goals  and  synergies  of  the  partners  and  their  respective  resources. 
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IV.  Summary  of  Results  During  the  Period  of  Performance 

A.  General. 

The  C^RP  program  was  originally  funded  through  an  award  from  ONR  in  FY  ’02.  This 
report  covers  an  award  that  began  on  9/30/2007  and  ended  on  9/30/2009.  General 
accomplishments  are  summarized  below.  Detailed  reports  are  presented  later  in  the 
document. 

An  overview  of  accomplishments  during  this  project  period  follows: 

•  Research  carried  out  by  the  CADRC  (Cooperative  Agent  Design  Research 
Center),  of  particular  interest  to  ONR  and  the  Marine  Corps,  was  again  funded.  A 
detailed  report  on  this  project  is  provided  in  Section  IV. C.  1  of  this  report. 

•  New  research  has  been  developed  and  some  research  has  been  continued, 
including  some  with  industry  collaboration.  Projects  address  topics  highly 
relevant  to  defense  and  national  security,  such  as  data  acquisition,  imaging  and 
analysis,  energy  efficiency,  communications,  command  and  control, 
reconnaissance,  autonomous  vehicles,  bio/chemical  sensors,  robotics,  and 
risk/vulnerability  assessment.  Detailed  reports  of  the  results  of  these  projects  are 
presented  in  Section  IV. C. 2  of  this  report. 

•  Since  January  1,  2003,  C^RP-supported  faculty  have  received  ~$45  million 
($44,987,351)  in  competitive  funding  from  other  sources. 

•  New  research  capacity  was  developed,  including  new  instrumentation  and 
enhanced  infrastructure  (detailed  below  in  Section  IV.B). 

•  Funds  were  also  provided  to  support  small  student  research  projects  through 
collaboration  with  Cal  Poly’s  Honors  Program.  Talented,  high-achieving  students 
in  Cal  Poly’s  selective  Honors  Program  were  given  the  opportunity  to  work  on 
research  projects  with  a  faculty  member  for  1-2  academic  quarters  and  to  present 
their  results  at  a  campus  symposium  at  the  end  of  the  academic  year.  C^RP- 
supported  project  reports  are  presented  in  Section  IV. C. 3  of  this  report. 

•  Two  consultants  from  the  University  of  Washington  spent  two  days  on  campus 
meeting  with  various  faculty  and  academic  administrators  to  discuss  our  research 
and  development  and  technology  transfer  capability.  The  bios  of  the  two 
consultants  are  appended  (Appendix  A). 

•  Information  technology  infrastructure  support  was  provided.  Internet! 
connectivity  was  initially  acquired  for  the  campus  in  November  2001 ,  to  support 
current  and  future  research  efforts.  Intemet2  membership  and  connectivity  has 
continued  during  this  grant  period. 
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•  A  database  of  >70  technology-based  companies  that  are  potential  partners  in 
the  project  and  potential  research  collaborators  has  been  updated.  A  series  of  on- 
campus  research  forums  initiated  last  year  was  continued.  Companies  were 
invited  to  campus  two  times  during  the  last  year  to  learn  about  specific  University 
research  projects  and  identify  potential  areas  for  collaboration.  Several 
collaborative  relationships  have  developed. 

•  The  first  research  and  development  company  to  be  located  on  campus  in 
anticipation  of  the  construction  of  the  pilot  building  for  the  technology  park 
continues  to  flourish  in  the  campus  environment  and  has  developed  research 
collaborations  with  faculty  in  several  different  disciplines  and  colleges.  These 
have  resulted  in  two  federal  research  grants  (USDA  and  NIH)  in  the  areas  of 
alternative  fuels  from  biomass  and  oral  vaccines,  respectively.  The  company. 
Applied  Biotechnology,  Inc.,  specializes  in  the  use  of  genetically  modified  plants 
to  produce  non-food  products,  for  example,  industrial  enzymes,  biochemical 
reagents  and  oral  vaccines.  The  presence  of  the  company  has  spurred  faculty  to 
develop  research  in  this  area  and  a  specialized  research  greenhouse  supports  this 
developing  work.  A  second  company  has  been  recruited  to  campus,  specializing 
in  object-oriented  software  development. 

•  Cooperative  relationships  have  been  established  or  renewed  with  technology 
companies  that  are  potential  research  collaborators,  including:  Cascade  Designs 
(water  treatment  systems),  Stellar  Explorations  (aerospace),  Toyon  (radio 
frequency  and  electronics),  Phycotech  (algae  for  biofuel).  Visual  Purple  (virtual 
realilty),  Moch  International  (catalyst  manufacturer).  Horsepower  LLC  (computer 
applications),  Couto  Solutions  (software),  ARB  Green  Power  (hybrid  vehicles), 
Electricorc  (R&D  consortium).  Discovery  Life  Sciences  (life  sciences  research). 
Medusa  LLC  (R&D  consortium),  EFuel  (alternative  fuels),  Vetel  Diagnostics  (life 
sciences),  Rantec  (power  systems),  Nextintent  (aerospace  systems). 

•  The  web  site  for  the  project  (www.c3rp.org),  which  presents  C^RP  as  an 
interface  between  Cal  Poly  and  business/industry  for  the  purpose  of  facilitating 
R&D  relationships,  was  updated. 

•  Efforts  continue  to  develop  industry  partners  in  the  area  of  alternative  energy 
and  energy  efficiency  for  the  purpose  of  developing  research  in  this  field.  To  this 
end  we  have  worked  with  Phycotech,  First  Solar,  Continental  WindPower,  EFuel, 
Energy  Alternative  Solutions,  Inc.,  Pacific  Gas  &  Electric,  Rey  Energy,  and  Blue 
Aqua  Solutions. 

•  The  project’s  leaders  have  continued  to  work  with  other  private  and  government 
partners  to  advance  the  project  and  to  attract  research  collaborators  and  support, 
including  the  Institute  for  Energy  Efficiency  at  the  University  of  California,  Santa 
Barbara  and  the  Naval  Facilities  Engineering  Command  at  Port  Huenemc.  During 
this  project  period,  we  continued  to  use  funding  provided  by  the  Economic 
Development  Administration  for  construction  of  the  first  building  of  the 
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technology  park.  Construction  began  in  November  2008  and  will  be  completed 
in  Spring  2010;  construction  is  about  45%  complete.  We  are  currently  negotiating 
leases  with  technology-based  companies  that  will  become  the  first  tenants  in  the 
building.  Criteria  for  tenant  selection  include  significant  R&D  activity  in  areas 
that  complement  Cal  Poly’s  research  strengths  and  a  commitment  to  collaboration 
with  faculty. 

B.  Development  of  new  research  capacity 

One  of  the  goals  of  the  project  was  to  increase  the  capacity  of  the  organization  to  carry 
out  state-of-the-art  research  in  the  areas  of  interest.  To  this  end,  specialized 
instrumentation  was  acquired  and  infrastructure  was  developed,  as  detailed  below. 

1.  Instrumentation. 

We  acquired  the  following  major  equipment/systems.  Other  minor  instrumentation, 
acquired  for  use  on  individual  projects,  is  described  in  the  reports  for  those  projects. 

NanoTest  System 

This  is  a  fully  flexible  nano-mechanical  property  measurement  system,  capable  of 
measuring  hardness,  modulus,  toughness,  adhesion  and  many  other  properties  of  thin 
films  and  other  surfaces,  as  well  as  single  dynamical  load  and  displacement  ranges. 
Sample  environment  and  impacting  conditions  can  be  set  up  to  closely  replicate 
conditions  that  these  materials  actually  see  in-use.  The  NanoTest  is  a  fully  modular 
system  that  allows  the  user  to  configure  the  system  to  meet  his/her  individual  needs, 
making  it  particularly  suitable  for  the  shared  use  that  we  engage  in. 

This  system  has  been  used  by  C^RP  researchers  in  various  departments  (Materials 
Engineering,  Chemistry,  Aerospace  Engineering,  Mechanical  Engineering)  who  work  on 
surface  properties  of  coatings,  composites  and  other  materials.  One  special  feature  of  the 
system  is  that  it  includes  a  higher  temperature  environment  than  any  other  currently 
available  competitive  product,  allowing  the  study  of  materials  in  a  high-temperature 
environment.  Current  projects  on  thin  films,  tissue  engineering  and  properties  of  bone 
have  benefited  from  the  availability  of  this  resource.  The  military  has  shown  interest  in 
medical  research  on  bone  physical  properties. 

Nanoflow  HPLC  and  Chip/MS  (ion  trap)  Analytical  System 

The  acquired  system  is  the  combination  of  a  nanoflow  HPLC  and  a  Chip/MS  (ion  trap) 
analytical  system.  Analysis  of  molecules  by  this  system  consists  of  powerful  resolution 
by  HPLC  (separation  of  myriads  of  peptides  in  the  case  of  proteomics,  or  high  resolution 
of  any  other  chemicals),  followed  by  tandem  mass  spectroscopy  obtained  by  ion-trap 
methodology.  In  research  on  chemical  components  and  proteins,  this  is  the  state  of  the  art 
methodology  for  identification  of  molecules,  whatever  their  origin.  The  Agilent  1200 
Series  HPLC  combined  with  the  Chip/MS  system  is  a  new  microfluidic  chip-based 
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technology  for  nanospray  LC/MS.  Based  on  the  HPLC-Chip  and  HPLC-Chip  Cube  MS 
interfaee,  it  provides  a  new  level  of  nanospray  MS  sensitivity,  robustness,  ease  of  use  and 
reliability. 

Cal  Poly  entered  the  field  of  proteomie  analysis  after  the  first  wave  of  scientific  and 
technical  advances  had  resulted  in  a  second  generation  of  protocols  and  instrumentation. 
Proteomics  is  the  simultaneous  analysis  of  all  the  proteins  in  a  living  system,  microbe  or 
organ.  The  analytical  system  we  acquired  provides  the  flexibility  needed  to  address  the 
diverse  scientific  needs  of  the  users  at  Cal  Poly  for  moleeule  identifieation.  For  example, 
the  instrument  has  a  very  high  sensitivity  which  is  necessary  for  the  quality  of  research 
we  are  eondueting  in  the  field  of  proteomies,  but  ean  also  easily  be  used  by  chemists 
working  with  pure  substances.  Very  important  is  its  ease  of  use  and  maintenance.  The 
separation/chromatography  chemistry  can  be  modified  by  changing  a  ‘chip’  (the  size  of  a 
credit  card),  which  is  very  convenient  in  an  environment  of  diverse  research  work. 

The  analytieal  system  has  been  used  to  support  a  number  of  C^RP  projeets,  among  them; 

o  Proteomie  analysis  of  milk  fat  globule  membrane  proteins  as  biologically  active 

compounds.  The  instrument  is  used  to  characterize  proteins  of  the  milk  fat  globule 
membrane  in  an  ongoing  C^RP-supported  project  to  determine  the  beneficial 
effects  of  these  unique  proteins  on  human  health  and  performance. 

o  Reactive  coatings.  The  system  is  used  to  characterize  synthetic  molecules  being 
created  in  the  lab.  These  molecules  are  being  immobilized  in  polymers  and  on 
surfaces  for  the  neutralization  of  chemical  and  biological  warfare  agents. 

o  Post-translational  modifications  in  enzymes  and  proteins.  Using  this  instrument, 
kinase/phosphatase  activity  is  monitored  for  important  biological  processes,  such 
as  signaling  in  malarial  diseases.  This  tool  allows  us  to  determine  the  location 
and  extent  of  phosphorylation  in  enzymes  important  to  this  disease. 

o  Novel  marine  natural  products.  This  instrument  is  a  vital  component  of 

characterization  of  new  products  currently  being  isolated  in  the  lab.  The  ability  to 
confirm  both  molecular  mass  and  structure  provides  invaluable  information  on 
their  nature  and  potential  uses. 

o  Tracking  environmental  change  in  marine  organisms.  This  C^RP  project  uses  the 
instrument  to  complement  other  proteomics  capabilities  that  exist  in  the 
Department  of  Biological  Sciences  (MALDl-TOF-TOF).  The  clcctrospray  ion 
trap  enables  separation  of  proteins  by  liquid  chromatography,  allowing  the 
subsequent  use  of  MuDPIT  (Multi-Dimensional  Protein  Identification 
Technology),  a  powerful  protein-separating  technique  that  enables  a  high- 
throughput  mode.  Importantly,  the  MALDl-TOF-TOF  offers  excellent  mass 
accuracy  that  is  used  for  peptide  mass  fingerprinting,  while  the  electrospray  ion 
trap  offers  excellent  capabilities  for  de  novo  sequencing  of  peptides  and  for  the 
identification  of  post-translational  modifications. 
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Other  Instrumentation 

Total  Organic  Carbon  Analyzer  —  used  for  biofuels  research,  specifically  to  conduct 
carbon  mass  balances  on  algae  ponds. 

Kieldahl  Apparatus  —  used  for  nitrogen  analysis  in  a  variety  of  research  applications, 
including  biofuels  research. 

Single  and  Multi-cell  Impedance  Sensor  on  Chip  -  a  custom-designed  instrument  created 
for  bio/chemical  sensing. 

Differential  Interference  Contrast  Microscopy  System  -  used  to  study  the  effects  of 
neurotoxins  (nerve  gases)  in  a  model  cellular  system. 

Reactive  Ion  Etcher  System  -  this  enhancement  to  our  microfabrication  laboratory  uses  a 
plasma  (rather  than  environmentally  dangerous  chemicals)  to  etch  silicon,  silicon  dioxide 
and  silicon  nitride  and  is  used  to  fabricate  microfluidic  devices  (lab-on-chip)  and 
microscale  electrostatically  actuated  mirrors;  and  in  some  solid-state  lighting  applications 
(white  LEDS). 

2.  Infrastructure. 

In  the  infrastructure  area,  the  following  projects  were  supported. 

Development  of  a  laboratory  to  investigate  injury-repair  in  skeletal  muscle  and 
vasculature  after  traumatic  injury  and  ischemia.  Equipment  was  acquired  to  support 
this  research  which  uses  state-of-the-art  molecular  and  genetic  techniques  to  study 
muscle  repair  and  angiogenesis.  More  detail  is  provided  in  section  IV.C.2. 

Development  of  a  Biosafety  Level  II  Facility  for  biosecurity  research.  The  facility 
includes  an  autoclave,  biosafety  cabinets  and  incubators  and  meets  the  standards  for 
conducting  BL-II  research.  The  facility  will  be  used  for  biosecurity  research  related  to 
protecting  the  food  supply  by  monitoring  and  detecting  pathogens. 

Development  of  an  Auto-Control  System  for  remote  operation  of  a  Yamaha  RMAX 
helicopter.  The  system  has  been  developed  to  remotely  operate  a  research-scale 
helicopter  donated  to  the  program  by  Northrop  Grumman.  It  will  run  piloting  software 
and  sensing  systems.  More  detail  is  provided  in  section  IV.C.2. 


C.  Detailed  research  reports 

The  remainder  of  this  report  contains  detailed  individual  reports  of  the  technical  results  of 
the  research  projects  carried  out  during  this  project  period.  They  are  presented  in  the 
following  order: 
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1.  Collaborative  Agent  Design  Research  Center  (CADRC)  project  report 

2.  Other  research  project  reports 

3.  Honors-student  project  reports 

Representative  publications  resulting  from  this  work  are  included  with  the  individual 
reports.  Documents  that  supplement  the  reports  are  included  in  Appendix  B. 
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Knowledge  Management  Project 
Collaborative  Agent  Design  Research  Center  (CADRC) 


Project  Investigator: 


Pohl Jens 

Department  of  Architecture 
California  Polytechnic  State  University 
San  Luis  Obispo,  CA 
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Knowledge  Management  Project 

Collaborative  Agent  Design  Research  Center  (CADRC) 


Executive  Summary 

With  the  rising  popularity  of  distributed  eomputing  (e.g.,  Web  Serviees),  the  proeess  of 
mapping  data  within  and  between  data  models  has  beeome  a  primary  foeus  of 
eomputerized  information  system  development.  Though  methodologies  have  been 
developed  to  overeome  the  syntaetie  and  semantie  obstaeles  to  the  interoperability  of 
heterogeneous  data  models,  too  often  these  methodologies  are  labor-intensive,  prone  to 
error,  and  require  the  applieation  of  eonsiderable  teehnieal  and  domain-funetional 
expertise.  In  addressing  this  growing  problem,  researehers  and  students  at  the 
Collaborative  Agent  Design  Researeh  Center  (CADRC)  have  developed  the  Intelligent 
Mapping  Toolkit  (IMT).  IMT  is  a  software  system  that  provides  deeision  support  for 
mixed-initiative  semantie  mapping  of  metadata  and  instanee  data  between  relational  data 
models. 

To  automate  speeifie  aspeets  of  the  semantie  mapping  problem,  IMT  employs  a  variety  of 
reasoning  paradigms  in  the  form  of  software  agents  to  support  human  analysis.  These 
paradigms  are  drawn  from  the  field  of  artifieial  intelligenee  (AI).  IMT  utilizes  a  novel 
federation  of  software  agents  eapable  of  leveraging  an  open-ended  set  of  reasoning 
methods,  as  well  as  derivatives  of  these  software  agents  to  eorreet  data  quality  issues 
stemming  from  network-eentrie  eomputing. 


Introduction 

In  its  previous  researeh  efforts,  the  CADRC  has  studied  the  interoperability  of 
heterogeneous  data  models  in  the  domain  of  logistieal  deeision-support.  The  applieation 
of  this  researeh  led  to  the  design  and  implementation  of  the  Intelligent  Mapping  Toolkit 
(IMT)  in  the  2006-2007  researeh  eyele.  This  initial  version  of  IMT  proved  to  be  an 
effeetive  multi-agent  semantie  mapping  tool  with  demonstrated  utility  for  large-seale 
problems  and  the  potential  to  dramatieally  improve  mapping  throughput  by 
USTRANSCOM  analysts  dealing  with  data  quality  issues  in  support  of  military  logisties. 
Through  the  IMT  software,  the  CADRC  has  demonstrated  that  eombinations  of 
intelligent  agent  eomparators  are  more  effeetive  than  eomparators  operating 
independently. 

During  the  2007-2008  projeet  year,  researehers  and  developers  at  the  CADRC,  under  the 
auspiees  of  the  California  Central  Coast  Researeh  Partnership,  extended  IMT’s  initial 
data  analysis  support  and  its  semantie-based  mapping  eapabilities  to  offer  a  wider  range 
of  serviees  ineluding: 

•  New  intelligent  agent  eomparators  to  realize  greater  mapping  effeetiveness. 
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•  Data  cleansing  capabilities  for  the  correction  of  flaws  in  operational 
enterprise  information. 

•  Intelligent  data  querying  eapabilities. 

These  eapabilities  ean  be  employed  to  help  relieve  diffieulties  assoeiated  with 
interoperability  among  the  underlying  data  of  the  many  disparate  systems  within  the 
United  States  Department  of  Defense  (DoD).  This  report  deseribes  the  evolution  path  to 
the  eurrent  version  of  the  IMT  software,  as  well  as  future  development  goals. 


Project  Description 

The  IMT  technology  evolved  to  transeend  the  original  vision  of  supporting  analysts  in 
mapping  the  data  representations  of  legaey  systems  to  a  eommon  shared  representation. 
This  was  achieved  by  providing  Intelligent  Referenee  Data  Management  (IRDM) 
services  that  support  semantie  mapping,  data  analysis,  operational  data  eleansing,  and 
intelligent  queries.  All  of  these  serviees  were  designed  to  be  the  building  bloeks  of  a 
problem-specific  software  artifaet.  The  following  seetion  deseribes  the  outeome  of 
current  efforts  to  enhanee  this  IMT  teehnology  foundation. 


Semantic  Mapping 

Data  mapping  is  the  proeess  of  logieally  eorrelating  data  elements  among  heterogeneous 
data  models.  Because  these  heterogeneous  data  models  ean  exhibit  data  diserepancies, 
IMT  teehnology  exploits  semantie  relationships  and  suggests  the  semantie  mappings 
necessary  for  addressing  and  resolving  data  discrepancies.  The  foundational  mapping 
services  and  their  similarity  agents  define  the  eore  of  IMT  teehnology. 


Figure  1:  Example  illustration  referencing  key  elements  of  the  Relational  Model. 

IMT  technology  assumes  data  models  involved  with  mapping  conform  to  the  relational 
model  as  illustrated  in  Figure  1.  Translator  modules  are  used  to  marshal  external  data 
sources  to  relational  model  compliant  data  sources  during  run-time  mapping  (e.g.,  data  is 
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translated  to  a  commonly  shared  representation  as  mapping  takes  place).  Similarly,  data 
brokering  modules  are  used  to  marshal  external  data  artifacts  to  relational  model 
compliant  data  artifacts  prior  to  mapping  (e.g.,  mapping  occurs  over  data  elements  of  a 
commonly  shared  representation). 

In  review,  the  original  tasks  that  the  IMT  was  built  to  carry  out  include: 

1.  Metadata  mapping:  This  entails  discovery  of  tables  and  fields  (e.g.,  structural 
data  elements)  in  a  target  database,  which  correspond  to  tables  and  fields  in 
the  source  database.  Documentation  of  this  relationship  is  referred  to  as 
metadata  mapping.  The  IMT  documents  two  types  of  metadata  mappings: 

a.  Relation  mapping  -  the  relationship  between  a  relation  or  table  from 
one  database  to  a  relation  or  table  of  another  database. 

b.  Attribute  mapping  -  the  relationship  between  an  attribute  or  column 
from  one  relation  to  an  attribute  or  column  of  another  relation. 

2.  Instance-data  mapping:  This  entails  the  discovery  of  records  (e.g.,  value  data 
elements)  in  a  target  relation,  which  correspond  to  records  from  the  source 
relation.  Documentation  of  this  relationship  is  called  an  instance-data 
mapping. 


Comparison  Category 

Comparison  Agent 

Text 

•  Semantic  Text  (Inexact  match) 

•  Key  (Exact  match) 

•  Phonetic 

Location 

•  Geo-Spatial  Location 
o  Latitude-Longitude 
o  Zip  Code 

Quantity 

•  Weight 

•  Volume 

•  Dimension 

Numeric 

•  Real  Number 

•  Date 

•  RGB  Color 

Generic 

•  Data- Value 

Table  1:  The  IMT  Similarity  Agents. 


Note  that  the  word  correspond  in  the  previous  context  is  used  loosely.  The  criteria 
leveraged  to  promote  candidate  mappings  come  from  two  sources: 

1.  Software  Similarity  Agents:  Agents  are  geared  toward  solving  domain- 
specific  problems.  If  an  agent  specializes  in  comparing  colors,  then  given 
characteristics  of  two  colors  the  agent  will  produce  an  objective  value  that 
can  be  utilized  to  gauge  similarity.  Table  1  lists  agents  currently  available  to 
IMT. 
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2.  Humans:  Human  reasoning  is  an  integral  part  of  determining  correct  data 
mappings,  since  agent  reasoning  is  limited  to  the  information  available  about 
data  elements.  While  the  results  of  several  agents  can  be  aggregated  in  order 
to  attempt  to  suggest  the  most  accurate  data  mapping,  a  human  may  have 
domain-specific  knowledge  that  the  agent  does  not  have.  For  this  reason  a 
human  should  always  be  allowed  to  participate  in  the  mapping  process. 

The  following  sections  describe  enhancements  to  the  IMT  technology's  semantic 
mapping  capabilities  that  were  designed  and  implemented  during  the  past  project  cycle. 


Data  Value  Agent 

Often  metadata  embedded  in  multiple  domains  is  found  to  be  of  such  poor  quality  that 
insufficient  semantic  context  is  available  to  existing  IMT  metadata  mapping  agents  to 
provide  useful  mapping  suggestions. 

Unlike  the  original  IMT  metadata  mapping  agents,  the  Data  Value  Agent  does  not  rely  on 
the  characteristics  of  attributes  but  rather  assists  in  creating  metadata  mappings  by 
determining  the  similarity  between  two  relational  attributes  based  on  their  values  in  a  set 
of  reference  data  (Figure  2).  If  the  values  are  of  a  comparable  data  type,  then  instance- 
based  agents  (currently  utilizing  term  classification  with  text  and  numeric  similarity 
comparators)  are  employed  to  provide  a  similarity  metric  for  the  attributes. 


In  order  to  apply  the  Data  Value  Agent, 
a  set  of  reference  data  must  exist, 
supporting  each  attribute  in  question. 
From  a  sample  of  each  reference  data  set 
the  Data  Value  Agent  determines  the 
type  of  data  associated  with  the  attribute 
(i.e.,  alphanumeric,  numerical,  a  single 
character,  and  so  on)  and  assigns 
similarity  agents  accordingly.  The 
results  of  these  agents  can  be  aggregated 
with  results  of  other  metadata  mapping 
agents  to  increase  the  accuracy  of  the 
metadata  mapping  suggestions. 


Figure  2:  A  comparison  is  made  between  instances 
of  two  attributes. 


Phonetic  Agent 

One  of  the  subjects  of  research  and  development  in  2008  involved  the  expansion  of 
IMT's  collection  of  agents  to  include  the  Phonetic  Agent.  The  Phonetic  Agent  brings 
IMT  technology  closer  to  the  world  of  natural  language  processing  by  utilizing  sounds 
involved  in  human  speech  to  determine  the  similarity  between  words  and  phrases. 

The  Phonetic  Agent  employs  a  Double  Metaphone  algorithm  to  classify  words  by  their 
pronounced  sound  (Philips  2000).  For  example  the  terms  “anaconda”  and  “annahkanda” 
will  both  transform  to  “ANKNT”  and  be  considered  equivalent  by  the  Phonetic  Agent. 
To  produce  a  similarity  metric,  the  Phonetic  Agent  classifies  every  two-gram  derivative 
of  the  reduced  terms  and  employs  the  Case-Based  Classification  engine. 
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Semantic  mapping  services  offered  by  IMT  technology  can  readily  take  advantage  of  the 
Phonetic  Agent  by  assigning  a  weighting  factor  that  allows  the  results  produced  by  the 
agent  to  contribute  to  the  overall  similarity  metric  of  the  data  elements  for  both  metadata 
and  instance-data  mapping  suggestions. 


Color  Agent 

An  instance-data-based  agent  that  has  recently  been  added  to  the  IMT  technology’s  suite 
of  similarity  agents  is  the  color  agent.  The  color  agent  determines  the  similarity  between 
two  Red-Green-Blue  (RGB)  color  values.  A  color  can  be  broken  up  into  its  red,  green, 
and  blue  components,  each  ranging  from  zero  to  255.  For  example,  a  very  bright  red 
color  would  have  a  red  component  of  255,  a  green  component  of  zero,  and  a  blue 
component  of  zero.  The  simple  but  effective  approach  taken  by  the  Color  Agent  is  to  plot 
the  red,  green,  and  blue  values  for  any  two  eolors  in  three-dimensional  spaee  on  x,  y,  and 
z  axes,  respectively.  A  traditional  three-dimensional  distance  formula  is  then  applied  to 
produce  a  metric  that  represents  the  similarity  between  the  two  eolors,  relative  to  the 
other  colors  in  the  data  that  are  being  eonsidered. 

Because  a  typical  set  of  data  will  not  contain  the  red,  green,  and  blue  integer  values  for  a 
color  attribute  (i.e.,  a  database  of  people  might  list  a  person’s  hair  color  as  brown),  the 
color  agent  supports  the  loading  of  synonyms  prior  to  determining  color  similarity.  A 
synonym  passed  to  the  color  agent  is  expected  to  map  the  name  of  a  color  (i.e.,  green)  to 
a  hexadecimal  value  (i.e.,  OxOOFFOO).  The  red,  green,  and  blue  values  are  extraeted  from 
the  hexadecimal  value  and  arc  used  in  place  of  the  data  wherever  the  name  of  the  eolor  is 
found. 


Intelligent  Query 

A  direct  derivative  of  the  mapping  technology  is  the  intelligent  or  semantic  query 
capability.  The  existing  IMT  instance-data  mapping  agents  allow  for  the  performance  of 
inexact  queries  across  any  type  of  character-encoded  data.  Every  reference  data  set 
attribute  specified  within  data  managed  by  IMT  is  associated  with  an  agent  that  will 
perform  instanee-data  similarity  eomparisons  to  aehieve  a  powerful  query  by  similarity 
capability. 

The  scope  of  database  query  facilities  desirable  for  a  semantic  search  capability  far 
exceeds  traditional  database  management  system  (DBMS)  funetions.  They  presuppose  a 
level  of  embedded  intelligence  that  has  not  been  available  in  the  past.  Some  of  these 
desirable  features  include;  conceptual  searches  instead  of  faetual  searches;  automatically 
generated  search  strategics  instead  of  predetermined  search  commands;  multiple  database 
access  instead  of  single  database  access;  analyzed  seareh  results  instead  of  direct  (i.e., 
raw)  seareh  results;  and,  automatic  query  generation  instead  of  requested  searches  only. 

A  traditional  DBMS  typically  supports  only  factual  searches.  In  other  words,  users  and 
applications  must  be  able  to  define  precisely  and  without  ambiguity  what  data  they 
require.  In  complex  problem  situations  users  rarely  know  exactly  what  information  they 
require.  Often  they  can  define  in  only  conceptual  terms  the  kind  of  information  that  they 
are  seeking.  Also,  they  would  like  to  be  able  to  rely  on  the  DBMS  to  automatically 
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broaden  the  search  with  a  view  to  discovering  information.  Traditional  query  technology 
utilizes  exact  match  and  Boolean  logic  constraints  to  identify  and  retrieve  an  item  of 
interest  (e.g.,  name  =  Joe  or  length  <  100).  In  traditional  search  engines,  Boolean  logic 
keywords  are  commonly  used  for  identifying  items  of  interest  (e.g.,  description  contains 
‘Joe’).  IMT  technology  offers  the  ability  to  search  inexactly  on  free  form  text. 

An  effective  query  mechanism  is  broken  into  two  major  components: 

1.  Term  Parser.  All  known  documents  and  query  criteria  are  divided  into  terms. 
Terms  can  represent  paragraphs,  sentences,  phrases,  words,  or  even  pieces  of 
words,  such  as  n-grams  and  phonetic  parts.  IMT  technology  is  built  on  n- 
gram  (specifically  tri-gram)  and  word  terms.  Due  to  the  abundance  of  terms, 
an  efficient  data  structure  that  supports  rapid  maintenance  and  retrieval  should 
be  used.  A  typical  data  structure  for  this  purpose  is  some  variant  of  a  B-tree. 

2.  Similarity  Comparator.  After  the  terms  of  a  documents  have  been  extracted 
and  indexed  in  a  data  structure,  the  next  step  in  the  information  retrieval 
process  involves  comparing  terms  from  the  query  criteria  to  the  indexed  terms. 
This  comparison  leverages  IMT's  instance-data  mapping  agents. 

Intelligent  query  is  an  evolving  capability  of  IMT  technology  that  is  proving  useful  for 
USTRANSCOM  endeavors.  This  technology  will  receive  a  great  deal  of  focus  for  2009 
efforts  involving  Document  Search  and  Agent-Based  Semantic  Search  capabilities. 


Data  Cleansing 

Data  cleansing  is  the  process  of  validating  error  prone  operational  data  against  reference 
data,  finding  invalid  or  questionable  attribute  values,  and  presenting  suggestions  for 
correction.  The  end-result  is  a  set  of  higher  quality  data  with  few  or  no  errors. 

There  are  two  common  practices  that  introduce  errors  into  data. 

•  System-to-system  data  transfer.  When  data  are  transferred  from  one  system 
to  another  system,  there  is  a  chance  that  data  can  be  altered  due  to  data  model 
translation  mistakes.  When  this  cycle  is  repeated,  the  problem  compounds 
resulting  in  partially  invalid  data. 

•  Human  input:  When  data  are  manually  entered  into  a  system,  the  human  user 
can  make  mistakes  and  enter  invalid  data.  Many  times  these  errors  will  have  a 
pattern  such  as  neighboring  keys  on  the  keyboard  being  pressed  instead  of  the 
correct  key.  Homoglyphs,  as  described  previously,  can  also  add  to  errors 
whenever  data  are  entered  manually. 

Guaranteeing  the  accuracy  of  operational  data  is  crucial  precisely  because  such  data  are 
commonly  used  as  an  input  to  systems  that  rely  on  valid  data  in  a  standard  format.  Most 
systems  will  fail  when  provided  with  slight  alterations  of  an  expected  data  format,  even 
though  the  data  may  be  meaningful  to  a  human  operator. 

In  order  to  cleanse  data,  a  great  deal  must  be  known  about  the  reference  data  that  acts  as 
an  oracle  in  the  cleansing  process.  By  making  use  of  the  semantic  mapping  tools  offered 
by  the  IMT  technology,  metadata  and  instance-data  relationships  between  data  elements 
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are  first  exposed.  For  a  simple  example,  suppose  that  operational  data  eontains  the  name 
of  a  rainforest  animal.  In  order  for  the  data  cleansing  process  to  cheek  if  the  animal  name 
is  present  in  the  Rainforest  Animals  reference  data  shown  in  Figure  1,  a  metadata 
mapping  must  exist  between  the  operational  and  reference  attributes.  Onee  the  proper 
metadata  and  instance-data  mappings  are  established,  then  the  following  types  of 
validations  can  occur: 

Identifier  Validation:  Identifiers  are  distinguished  by  known  attribute  mappings 
from  an  operational  data  table  to  a  reference  data  table.  If  an  identifier  value  in 
the  operational  data  is  not  found  in  the  reference  data,  then  the  operational  value 
is  deemed  invalid.  For  example,  suppose  that  the  operational  data  contain  an 
identifier  attribute  corresponding  to  the  Common  Name  attribute  shown  Figure  1 
with  the  attribute  value  of  "Polar  Bear."  IMT  technology  determines  that  "Polar 
Bear"  is  not  a  valid  Common  Name  for  a  rainforest  animal  because  it  is  not  part 
of  the  reference  data. 

Intra-Instance  Field  Validation:  Given  an  identifier,  a  reference  data  table  may 
contain  attributes  expressing  eharaeteristies  of  the  identified  entity  (i.e.,  a  tree  frog 
has  four  legs).  The  operational  data  may  contain  the  same  attributes,  thus  it  is 
possible  to  correlate  records  based  on  an  identifier  attribute  and  validate 
supporting  attribute  values.  Suppose  the  operational  data  specifies  that  a  tree  frog 
has  six  legs.  While  it  is  entirely  possible  for  a  Rainforest  Animal  to  have  six  legs, 
it  is  not  valid  for  a  tree  frog  to  have  six  legs.  In  this  case  the  operational  value  is 
deemed  invalid  and  since  the  IMT  technology  has  successfully  correlated 
operational  data  with  reference  data  to  determine  that  the  combination  is  invalid, 
the  correct  reference  data  values  can  be  acquired  as  suggested  eorreetions.  This 
type  of  validation  utilizes  only  a  single  reference  data  set  and  no  instanee-data 
mappings. 

Inter-Instance  Field  Validation:  This  type  of  validation  produces  the  same 
results  as  the  Intra-Instanee  Field  Validation;  however,  it  works  across  multiple 
reference  data  sets  tied  together  by  instance  mappings. 

Constraint  Validation:  This  technique  does  not  rely  on  reference  data  but  rather 
on  domain-specific  constraints.  An  operational  attribute  value  is  deemed  valid  if 
it  conforms  to  a  Boolean  logic  constraint  such  as:  less  than;  starts  with;  or, 
matches  a  regular  expression. 

Complete  Record  Validation:  The  IMT  technology  validation  service  includes  a 
module  that  performs  complex  SQL  queries  to  correlate  operational  data  with 
reference  data  and  determines  the  minimal  number  of  required  changes  to  a  record 
in  order  to  deem  it  entirely  valid.  This  capability  relies  heavily  on  the  other 
validation  techniques  and  is  not  useful  for  determining  what  makes  a  record 
invalid,  but  suggests  how  to  fix  it. 
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Suggestions'.  Suggestions  for  the  correction  of  attribute  values  to  establish 

validity  are  the  result  of  two  processes: 

•  Intelligent  Query:  Continuing  examples  with  the  rainforest  animals 
reference  data,  suppose  that  identifier  validation  deems  the  attribute 
value  "annahkanda"  invalid.  Leveraging  IMT  technology's  intelligent 
query  capability  in  conjunction  with  the  Phonetic  Agent,  the  data 
cleansing  technology  will  suggest  the  correction  "anaconda”. 

•  Instance  Correlation:  Intra-Instance  Field  Validation  and  Inter- 
Instance  Field  Validation  rely  on  enumerated  valid  candidate  values  to 
determine  validity  of  attribute  values.  If  an  attribute  value  is  deemed 
invalid  then  the  enumeration  of  valid  candidate  values  is  simply 
returned  as  suggestions. 

To  understand  a  comprehensive  example  of  data  cleansing,  please  first  review  Figure  3. 
The  operational  data  contains  seven  attributes:  stFirstName  (a  student's  first  name); 
stLastName  (a  student's  last  name);  profFirstName  (a  professor's  first  name); 
profLastName  (a  professor's  last  name);  section  (a  class  section);  grade  (a  student's  letter 
grade  for  a  class  section);  and.  Grade  Points  (a  student's  awarded  grade  points  for  a  class 
section).  Five  reference  data  sets  exist:  Students,  Professors,  Class  Sections,  Letter 
Grades,  and  Grade  Points.  Many  metadata  and  instance-data  mappings  exist  among  these 
data  sets,  exposing  the  relationships  within  and  among  the  data. 

The  following  validation  can  take  place  as  shown  in  Figure  3: 

1.  Leveraging  Identifier  Validation  reveals  if  a  student  with  the  specified  first 
name  exists. 

2.  Leveraging  Identifier  Validation  also  reveals  if  a  student  with  the  specified 
last  name  exists. 

3.  Leveraging  Intra-Instance  Field  Validation  reveals  if  there  exists  a  student 
with  both  the  specified  first  name  and  last  name  (e.g.,  the  combination  is 
valid). 

4.  Leveraging  Inter-Instance  Field  Validation  reveals  if  the  specified  student 
belongs  in  the  specified  class  section. 

Validation  will  continue  in  a  similar  fashion  until  every  operational  attribute  value  has 
been  validated. 
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Figure  3:  An  example  illustrating  the  relationships  among  reference  and  operational  data  sets. 


Service  Orientation 

IMT  was  designed  and  implemented  as  a  stand-alone  single-user  system.  Diverging  from 
the  monolithic  software  paradigm,  IMT  has  applieations  in  the  Software  as  a  Service 
(SaaS)  domain.  Services,  particularly  Web  Services,  expose  IMT's  core  capabilities  over 
a  network,  such  as  the  Internet,  for  use  by  other  software  applications  in  completing  their 
work.  SaaS  services  take  advantage  of  concepts  drawn  from  the  Service-Oriented 
Architecture  (SOA)  paradigm  and  are  implemented  as  components  of  an  Enterprise 
Service  Bus  (ESB),  thereby  enabling  seamless  integration  into  diverse  systems. 

Service  interfaces  offered  by  IMT  technology  rely  on  XML-based  messaging  between  a 
client  and  server.  The  primary  interface  utilizes  the  World  Wide  Web  Consortium 
(W3C)  Simple  Object  Access  Protocol  (SOAP)  standard  to  achieve  intelligible 
communication  between  the  IMT  services  and  clients  (World  Wide  Web  Consortium 
2007,  April  27).  In  addition  to  the  SOAP  interface,  the  popular  but  non-standardized 
Representational  State  Transfer  (REST)  architecture  is  also  supported  for  XML  message 
exchange.  The  popularity  of  REST  stems  from  its  use  by  web  browsers  to  request  web 
page  content  over  the  Internet. 
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Support  for  the  service  interfaces  is  incomplete  without  resources  describing  the  data 
model  utilized  for  establishing  message  content.  IMT  technology  describes  its  service 
interface  data  model  via  the  W3C  endorsed  Web  Service  Description  Language  (WSDL) 
and  XML  Schema  (World  Wide  Web  Consortium  2007,  June  26).  Figure  4  illustrates  the 
service  interfaces  provided  by  the  Intelligent  Mapping  Facility,  which  are  described  in  a 
WSDL  document. 


Figure  4:  Service  Oriented  Architecture  of  the  Intelligent  Mapping  Facility. 


In  September  2008  the  CADRC  began  discussions  with  the  J6  division  of 
USTRANSCOM  relating  to  the  establishment  of  a  Knowledge  Management  Laboratory 
(KML)  as  a  field  research  unit  of  the  CADRC  Center.  The  KML  facility  would  serve  as  a 
test  bed  for  current  USTRANSCOM-J6  efforts  to  transition  to  an  information-centric 
SOA-based  knowledge  management  environment,  under  a  CRADA  contract.  The  goal  of 
the  laboratory  is  to  showcase  Software  as  a  Service  (SaaS)  concepts  and  provide  a  test 
bed  for  service  integration.  IMT  technology  was  featured  as  a  primary  player  in  the 
initial  test  bed  presentations. 


Second  Research  Cycle  (focus  for  2009) 

Document  Search 

The  focus  for  IMT  technology  research  in  2009  will  be  the  further  evolution  of  the 
intelligent  query  capabilities  to  support  document  search. 

Proposed  Areas  of  Research: 
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•  Research  of  Indexing  Technology’’.  The  current  intelligent  query  mechanisms 
adopted  from  the  IMT  semantic  mapping  technology  offer  a  linear  order  of 
complexity  for  term  classification.  For  very  large  data  sets,  searching 
complexity  of  this  magnitude  is  not  feasible  when  confronted  with  a  time 
sensitive  problem.  Indexing  technology  for  efficient  information  retrieval 
typically  involves  variants  of  an  Inverted  Index  and  B-tree  with  a  logarithmic 
worst  case  cost  in  locating  a  record. 

•  Information  Retrieval.  To  avoid  the  overhead  of  constructing  data  structures 
necessary  to  search  on  every  service  request,  the  proposed  new  indexing 
technology  would  construct  the  data  structure  on  the  server's  hard-disk  drive. 
Data  structure  content  on-disk  would  not  be  loaded  into  memory  when 
needed;  instead,  it  would  use  fast  disk  searching  algorithms  for  information 
retrieval. 

•  Term  Parsing  for  Standard  Document  Formats’.  To  accommodate  indexing  of 
documents,  terms  must  first  be  extracted  from  the  document's  content.  The 
goal  of  a  term  parser  is  to  locate  the  content  for  term  extraction  and  then 
employ  a  standardized  tokenizing  algorithm  (e.g.,  n-gram  tokenization).  The 
process  of  accessing  required  content  can  vary  among  document  formats, 
necessitating  the  need  for  specialized  term  parsers. 

•  Concept  Extraction’.  To  infer  categorization  by  extracting  the  meaning  from  a 
document.  For  example,  a  document  describing  "trees"  could  refer  to  Biology 
or  Computer  Science  because  the  keyword  can  have  different  meanings. 

•  Workload  Distribution  and  Clustering’.  To  allow  independent  instances  of 
IMT  services  to  work  together  in  solving  a  problem.  This  feature  may  involve 
partitioning  indexed  terms  among  servers. 

•  Identification  of  a  Test  Environment’.  To  select  an  appropriate  case  study 
testing  domain.  Initial  efforts  for  locating  a  suitable  testing  environment 
focused  on  working  in  the  domain  of  a  library;  particularly,  the  Kennedy 
Library  at  the  California  Polytechnic  State  University  (Cal  Poly)  in  San  Luis 
Obispo.  An  ideal  approach  for  integration  and  testing  of  the  search  technology 
would  entail  enhancement  of  the  library’s  recordkeeping  activities  to  supply 
an  inexact  full-content  search.  Other  possible  participants  include  the  Cal 
Poly  College  of  Architecture  and  Environmental  Design's  Media  Resource 
Center. 

Other  Areas  of  Research 

•  Service  Security  Layer.  Enforce  integrity  and  confidentiality  on  IMT  service 
messaging.  Initial  research  into  this  subject  should  revolve  around  the  Open 
Oasis  specification  WS-Security  (WSS).  WSS  describes  how  to  attach 
signatures  and  encryption  headers  to  SOAP  messages. 

•  Natural  Language  Processing:  Convert  human  language  into  a  more  formal 
and  consistent  representation  for  manipulation  by  computer  algorithms.  This 
subject  of  research  may  involve  determining  both  the  semantics  of  a  document. 
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or  extracting  additional  types  of  terms  from  a  document  (i.e.  Phoneme 
Extraction  Agent). 

•  WordNet  Integration".  Enhance  agent  growth  by  utilizing  external  resources 
such  as  WordNet,  a  publicly  available  linguistic  ontology  (Fellbaum  1998). 
WordNet  will  strengthen  an  agent's  ability  to  identify  occurrences  of 
terminological  variations  due  to  conceptual  abstraction.  For  example, 
WordNefs  hyponym  relationships  (is-a-type-of)  between  concepts  (i.e.,  a 
Swallowtail  Butterfly  is-a-type-of  insect)  can  be  exploited. 
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Project  title;  Quenched  Random  Disorder  in  Soft  Condensed  Matter. 

Investigator:  Saimir  Barjami,  Physics  Department,  Calpoly,  San  Luis  Obispo,  Ca. 
Project  Goal:  The  goal  of  this  project  was  twofold: 

1 .  To  establish  a  world-class  experimental  facility  in  the  Physics  Department,  in 
the  College  of  Science  and  Math,  California  Polytechnic  State  University  for 
the  study  of  order  and  disorder  phenomena  in  condensed  matter,  the  Order- 
Disorder  Phenomena  Laboratory. 

2.  To  study  the  physics  of  quenched  random  disorder  effects  on  the  phases  and 
phase  transitions  of  soft  condensed  matter  and  complex  fluids  (liquid  crystals). 

Summary  of  Results: 

I  will  present  the  summary  of  results  from  this  project  based  on  the  two  goals 
presented  in  the  “Project  Goal”  part  of  this  report. 

1.  Building  and  operation  of  the  AC  Calorimeter  for  the  Order-Disorder 
Phenomena  Laboratory. 

Two  students  were  hired  beginning  Spring  quarter  and  Summer  quarter  in  the 
construction  and  testing  of  AC  Calorimeter.  A  block  diagram  of  the  design  and 
electronic  equipment  of  the  ac  calorimeter  that  was  built  from  scratch  and  will  be  used 
in  this  work  are  presented  in  figures  1  and  2.  The  work  to  built  and  test  the  AC 
Calorimeter  extended  over  a  period  of  6  months,  from  March  2008,  till  August  2008, 
due  to  the  very  complex  nature  of  the  calorimeter. 


Figure  1:  Schematics  of  the  AC  Calorimeter  build  in  our  Order-Disorder  Phenomena 
lab.  The  sample  lies  inside  a  massive  copper  block,  which  is  temperature  controlled  to 
better  than  \mK  in  the  stepwise  mode. 
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Figure  2:  Block  diagram  of  Calorimeter  built  in  our  Order-Disorder  Phenomena  Lab., 
showing  all  the  connections  to  the  instruments.  The  whole  control  and  data 
acquisition  is  computer  controlled  through  a  GPIB  interface. 

A  detail  list  of  equipments  and  accessories  that  were  bought  to  construct  the 
calorimeter  will  be  attached  to  this  report  upon  request. 

Initial  Results  in  Testing  the  AC  Calorimeter. 

The  basics  of  the  AC  calorimetry  technique  consist  of  applying  periodically 
modulated  sinusoidal  power  to  the  material  to  be  studied,  and  monitoring  the  resulting 
sinusoidal  temperature  response  of  the  material.  After  sending  the  sinusoidal  power 
to  the  material  we  monitored  the  temperature  response  oscillations  attached  to  the 
sample.  Such  oscillations  arc  presented  in  Figure  3. 

The  data  shown  in  Figure  3  represents  the  raw  temperature  oscillations  in  the  sample, 
without  any  averaging  or  smoothing  routine  used,  which  highlights  again  the  very 
high  -  resolution  capabilities  of  our  calorimeter. 

Sinusoidal  response  of  the  sample  shown  in  Figure  3  is  a  direct  indicator  of  the 
successful  operation  of  the  new,  built  from  scratch  AC  Calorimeter  in  our  new  Order- 
Disorder  Phenomena  Laboratory,  which  we  employed  in  the  study  of  quenched 
random  disorder  effects. 
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Figure  3:  Sinusoidal  response  of  AC  Calorimetry.  The  data  shown  represents 
the  raw  temperature  oscillations  in  the  sample,  without  any  averaging  or  smoothing 
routine  used,  which  highlights  the  very  high  -  resolution  capabilities  of  our 
calorimeter. 


2.  Quenched  Random  Disorder  in  Soft  Condensed  Matter. 

The  isotropic  (/)  to  nematic  (TV)  phase  transition  is  weakly  first-order  and  the 
orientational  order  is  characterized  by  a  tensor  order  parameter.  In  the  presence  of 
dispersed  surfaces  as  the  source  of  the  Quenched  Random  Disorder  (QRD),  the 
disorder  couples  to  both  the  magnitude  and  the  direction  of  the  orientational 
anisotropy  axis  (the  director).  Thus,  in  general,  both  field-like  and  elastic  couplings 
may  occur.  In  Liquid  Crystals  (LC)  +  aerosil  systems,  the  soft  nature  of  the  gel 
partially  anneals  the  stronger  elastic  coupling  reveling  the  random-field  coupling  to 
the  magnitude  of  the  order  parameter. 

In  this  experimental  research  work  we  focus  on  a  liquid  crystal  -  4’  -  n  -  Pentyloxy  - 
4  -  Cyanobi  -  phenyl  (50CB).  We  prepared  several  samples  of  50CB  with  quenched 
random  disorder  (QRD)  incorporated  into  them.  QRD  in  Liquid  Crystals  (LC) 
requires  the  inclusion  of  fixed  random  solid  surfaces  at  all  possible  length-scales  up  to 
the  sample  size.  This  was  achieved  by  “dissolving”  type  300  aerosil  (SIL)  into  the 
host  LC.  The  SIL  is  comprised  of  SiOi  (silica)  spheres  of  diameter  about  7  nm,  coated 
with  {-OH  )  hydroxyl  group.  The  coating  enables  the  spheres  to  hydrogen  bond  and 
form  a  thixotropic  10,  fractal  gel,  in  an  organic  solvent,  through  a  diffusion  limited 
aggregation  process. 

Several  AC  Calorimetry  temperature  scans  were  carried  out  for  bulk  50CB  and  for 
several  densities  of  aerosil  particles  in  50CB: 


=0.078-^;  p,  =0.220^-,  =0.489-^;  p,  =  0.647-^.  This  work 

cm  cm  cm  ‘  cm 

was  carried  out  from  September  20  until  December  15. 

In  order  to  determine  the  excess  heat  capacity  associated  with  the  phase  transitions,  an 
appropriate  background  was  subtracted.  The  total  sample  heat  capacity  over  a  wide 
temperature  range  had  a  linear  background,  Q;(background),  subtracted  to  yield; 

AC^,  -Cp-C  p  [background) 

In  Figure  4  we  present  excess  specific  heat,  ACp,  as  a  function  of  temperature  for  bulk 
50CB  liquid  crystal  taken  with  our  new  AC  Calorimeter,  over  a  wide  range  of 
temperatures,  from  305  K  to  above  360  K.  A  Sharp  Isotropic  to  Nematic  phase 
transitions  is  observed  for  the  bulk  at  337  K.,  as  shown  clearly  in  Figure  4.  A  double 
calorimetric  feature  is  evident  in  the  I+N  coexistence  region  from  the  excess  specific 
heat  data  as  seen  in  Figure  4,  and  is  a  signature  of  the  first  order  character  of  this 
transition. 
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Figure  4:  Excess  specific  heat,  ACp,  as  a  function  of  temperature  for  bulk  50CB 
liquid  crystal.  The  vertical  dashed  line  indicate  the  /-A  transition.  Isotropic  to  Nematic 
phase  transition  is  observed  for  the  bulk  at  337  K. 


An  expanded  view  of  the  temperature  scan  data  about  the  Isotropic  to  Nematic  phase 
transition  as  a  function  of  temperature  is  shown  in  Figure  5.  A  double  calorimetric 
feature  is  evident  in  the  I+N  coexistence  region  from  the  excess  speeifie  heat  data  as 
seen  in  Figure  5,  and  is  a  signature  of  the  first  order  character  of  this  transition.  This  is 
a  clear  indication  that  the  release  of  the  latent  heat  is  affected  by  the  disorder,  and 
follows  a  two-step  process.  Disorder  seems  to  affect  both  the  magnitude  and  the 
dynamics  of  the  latent  heat  release. 


Previous  work  done  on  the  Isotropic  to  Nematic  phase  transition  for  CCN47  +  aerosil 
disordered  systems,  presented  in  the  Project  Proposal,  showed  a  similar  double 
calorimetric  feature  for  this  transition  and  offers  compelling  evidence  that  the  I-N 
transition  with  weak  quenched  random  disorder  proceeds  via  a  two  -  step  process,  in 
which  random-dilution  is  followed  by  random-field  interactions  on  cooling  from  the 
isotropic  phase,  a  previously  unrecognized  phenomena.  We  believe  the  double 
calorimetric  feature  evident  in  the  Isotropic  to  Nematic  phase  transition  for  bulk 
50CB  taken  with  our  new  Calorimeter,  confirms  that  result. 


Figure  5:  Expanded  view  of  the  temperature  scan  data  about  the  nematic  to  isotropic 
phase  transition  as  a  function  of  temperature  for  bulk  50CB  liquid  crystal.  The 
vertical  dashed  line  indicate  the  1-N  transition.  Isotropic  to  Nematic  phase  transition  is 
observed  for  the  bulk  at  337  K. 

After  bulk  50CB  data,  we  then  proceeded  with  several  AC  Calorimetry  temperature 
scans  for  50CB  +  aerosil  disordered  systems  for  several  densities  of  aerosil  particles 

in  50CB:  =0.078-^;  =0.220-^;  =0.489-^;  =0.647-^. 

cm  cm  cm  cm 

In  Figure  6  we  present  different  temperature  scan  data  taken  for  the  above  samples 

and  for  bulk  50CB. 

Isotropic  to  Nematic  phase  transitions  for  different  samples  are  clearly  indicated  in  the 
Figure  6  by  different  peaks.  Temperature  shifts  and  the  suppression  of  the  Isotropic  to 
Nematic  phase  transition  peaks  are  clearly  seen  in  Figure  6  as  the  density  of  silica  is 
increased  from  0.078  to  0.647  g/cm^. 

The  evolution  of  the  first  order  Isotropic  to  Nematic  phase  transition  peak  is  clearly 
indicated  from  the  picture  starting  from  the  bulk,  getting  bigger  for  0.078  g/cm^ 
sample,  getting  suppressed  for  the  0.220  g/cm^,  more  suppressed  for  0.489  g/cm^ 


sample  and  almost  smeared  out  for  0.647  g/em^  sample,  whieh  is  a  elear  signature  of 
the  Quenched  Random  Disorder  effeets  of  aerosil  partiele  in  50CB  liquid  erystal. 

The  effeet  of  quenehed  random  disorder  is  elearly  showing  in  the  data:  the  shift  in 
transition  temperatures,  the  broadening  of  the  transition  region,  the  suppression  of  the 
peak  with  inereasing  siliea  density,  and  even  the  eompletc  disappearanee  of  the  peak 
for  the  0.647  g/em^  sample. 
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Figure  6:  Excess  specific  heat,  AQ;,  as  a  function  of  temperature  for  bulk  50CB  and 
SOCB  +  aerosil  samples  at  different  silica  densities  taken  with  our  new  AC 
Calorimeter.  Isotropic  to  Nematie  phase  transition  regions  are  clearly  seen  in  the 
figure.  See  figure  insets  for  definition  of  symbols. 

The  1-N  Transition  Enthalpies: 

For  first-order  transitions  finding  the  I-N  transition  enthalpy  is  complicated  by  the 
presence  of  a  two-phase  coexistence  region,  as  well  as  a  latent  heat  A//.  The  total 
enthalpy  change  through  a  first-order  transition  is  the  sum  of  the  pre-transitional 
enthalpy  and  the  latent  heat.  In  an  /IC-calorimetric  measurement,  ACp  values 
observed  in  the  two-phase  region  arc  artificially  high  and  frequency  dependent  due  to 
partial  phase  conversion  during  a  Tac  cycle.  The  pre-transitional  enthalpy  SH  is 
typically  obtained  by  substituting  a  linearly  truncated  ACp  behavior  between  the 
bounding  points  of  the  two-phase  coexistence  region  into: 

<SI{  =  j 

An  independent  experiment  is  required  to  determine  the  latent  heat  A//.  A  direct 
integration  of  the  observed  ACp  yields  an  effective  transition  enthalpy  SH*  and  this 


contains  some  of  the  latent  heat  contributions,  thus  dH  <  dH*  <  =  SH  +A//. 

We  will  conclude  this  analysis  at  a  later  time. 

We  conclude  pointing  out  the  clear  success  of  our  project.  We  have  designed, 
constructed  and  successfully  tested  the  AC  Calorimeter,  which  did  require  an 
extensive  work  during  six  months  and  participation  in  the  project  or  two  undergrad 
students,  Aaron  Jahoda,  Physics  major,  and  Ryan  Koether,  Math  major.  We  have 
investigated  the  Quench  Random  Disorder  effects  in  50CB  liquid  crystal  +  aerosil 
samples  at  different  silica  densities. 

This  work  and  its  results  are  part  of  the  very  important  applications  of  Liquid  Crystals 
and  their  many  effects  in  many  areas  of  science  and  engineering,  as  well  as  device 
technology,  such  as  Optical  and  Radar  Imaging,  with  a  tremendous  interest  to  the 
Office  of  Naval  Research  .  Applications  of  Quenched  Random  Disorder  in  Liquid 
Crystals  are  still  being  discovered  and  continue  to  provide  effective  solutions  to  many 
different  problems. 

These  results  will  be  submitted  for  publication  in  one  of  Physical  Review  Journals  at  a 
later  time. 


Administrative  Details 

•  The  PI  took  2  units  release  time  in  Spring  Quarter  2008. 

•  The  PI  received  Summer  salary  from  this  project. 

•  Two  students  were  hired  during  Summer  Quarter  2008. 


NOOO 14-07-1-1 152 


P.l. Susan  C.  Opava,  Ph.D. 


Communication  within  Satellite  Constellations 

Introduction 

The  CubeSat’s  small,  standardized  form-factor  has  been  one  of  its  biggest 
assets.  It  allows  the  satellites  to  be  flown  economically,  enabling  a  myriad  of 
applications  and  experiments  that  were  previously  not  conducted  due  to  high 
launch  costs.  However,  this  same  form-factor  poses  one  of  the  biggest  engineering 
challenges  to  designing,  building,  and  deploying  CubeSats.  The  size  and  power 
constraints  that  result  from  such  a  small  enclosure  limit  the  complexity  of  the 
satellite’s  payload  and  corresponding  experiments. 

There  are  two  general  approaches  to  working  within  these  constraints.  The 
first  is  to  push  the  miniaturization  envelope,  creating  ever-smaller  payloads.  The 
second  approach  is  to  fly  multiple  satellites  in  a  constellation  (or  cluster)  that 
cooperate  with  each  other,  each  performing  a  piece  of  the  overall  mission.  To  date 
the  cluster  approach  has  been  rarely  used  with  extremely  small  satellites,  however 
the  operational  concept  is  well  known  and  discussed  amongst  CubeSat  developers. 

Current  CubeSat  communication  protocols  are  built  on  the  assumption  that 
the  ground  station  communicates  directly  with  the  satellite.  This  simplifies  protocol 
design  in  a  number  of  ways.  For  instance,  if  the  Cal  Poly  ground  station  has  a  packet 
to  send  to  a  CubeSat  (CPS),  it  simply  waits  for  CPS  to  pass  overhead  and  sends  the 
packet.  This  is  easier  than  sending  the  CPS  packet  to  the  first  satellite  that  passes 
overhead,  CP4,  and  then  depending  on  CP4  to  relay  the  packet  to  CPS.  This  relaying 
capability  is  a  fundamental  component  of  cluster  communication. 

Satellites  within  a  constellation,  especially  those  launched  in  different  P- 
PODs,  will  be  in  periodic  communication  range  of  each  other  as  determined  by  their 
orbits.  This  periodic  connectivity  requires  a  dramatically  different  routing  strategy 
than  is  employed  in  fixed,  "always  on"  connections.  Existing  CubeSat  ground 
stations  resolve  periodic  connectivity  through  the  use  of  human  operators  and 
orbital  predictions.  The  operators  use  the  predicted  time  of  the  next  pass,  prepare 
commands  for  the  satellite  in  advance,  and  then  perform  the  actual  communication 
as  the  satellite  passes  overhead.  Satellite  constellations,  on  the  other  hand,  have  no 
onboard  human  operator  responsible  for  communication.  All  the  scheduling, 
relaying,  and  routing  must  be  implemented  by  onboard  software. 

Initial  development  of  this  networking  software,  the  corresponding 
protocols,  and  the  necessary  tools  to  evaluate  them  before  flight,  was  the  focus  of 
this  work.  The  remaining  sections  in  this  report  provide  an  overview  of  the  work 
done  and  the  work  yet  to  do  in  four  important  areas,  including  how  this  work  aligns 
with  The  Office  of  Naval  Research  (ONR)  goals,  the  communication  protocol,  the 
protocol  simulator,  and  initial  protocol  analysis. 
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Alignment  with  ONR  Goals 

Satellite  constellations  can  be  used  to  solve  a  number  of  different  and  important 
problems.  The  research  in  this  proposal  is  a  fundamental  enabling  technology  for 
constellations.  This  section  describes  how  constellation  technology  could  be 
applied  to  three  different  categories  of  specific  interest  to  ONR  and  DOD:  national 
security  applications,  command  and  control  /  communication,  and  intelligence  / 
reconnaissance. 

This  work  has  two  primary  national  security  applications.  First,  a  large  part  of 
national  security  is  ensuring  that  our  critical  infrastructure  is  protected  against 
failure  when  attacked.  While  it  is  beyond  the  scope  of  this  work  to  identify  exactly 
what  constitutes  critical  infrastructure,  this  research  will  develop  and  evaluate 
different  technology  that  provides  the  most  basic  form  of  failure  protection, 
redundancy.  In  addition,  advanced  satellite  technology  is  considered  a  strategic 
advantage,  and  this  research  will  advance  the  state  of  the  art  in  satellite 
communication  technology. 

This  research  also  falls  squarely  into  the  ONR's  interests  of  command  and  control, 
computers,  and  communication.  The  broad  categories  of  computers  and 
communication  are  easily  meet  by  the  nature  of  the  research.  Specific  example 
applications  include  deploying  a  disruption  tolerant  satellite  network  that  can  carry 
mission  critical  data  securely  (command  and  control,  etc].  The  tolerance  is  obtained 
from  the  redundancy  in  the  system,  however  the  security  goal  is  not  as  obvious.  The 
underlying  technology  needs  to  be  designed  and  tested  such  that  is  operates 
correctly  even  when  under  computer-based  attacks,  like  Denial-of-Service  attacks, 
that  don't  cause  any  physical  harm  to  the  satellite. 

Finally,  the  ability  to  amortize  the  cost  of  a  single,  high  bandwidth  link  across  many 
satellites  makes  this  technology  ideal  for  intelligence,  surveillance,  and 
reconnaissance  applications  when  it  is  necessary  to  deploy  a  large  number  of 
resource  constrained  sensing  nodes  and  related  infrastructure. 

Protocol 

The  first  step  in  designing  a  routing  protocol  is  determining  the  overriding 
behavioral  categories  for  the  protocol.  These  categories  have  a  pronounced  impact 
on  the  details  of  the  design.  In  multi-hop  wireless  networks,  there  are  two  decisions 
to  make:  Should  the  protocol  be  proactive  or  reactive  and  should  the  protocol  be 
link-state  or  distance  vector. 

Proactive  protocols  determine  the  path  through  the  network  before  any  packet  is 
actually  transmitted.  This  is  used,  and  works  very  well,  in  static  networks  (like  the 
Internet)  and  multi-hop  routing  protocols  for  networks  whose  mobility  pattern 
results  in  nearly  static  networks. 

The  decision  was  made  to  use  a  proactive  protocol  for  satellite  cluster  networks 
because  of  two  factors.  First,  the  orbits  are  predictable.  The  satellites  themselves 
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can  make  high  quality  predictions  of  when  they  will  come  in  communication  range 
of  each  other.  This  makes  the  network  properties  closer  to  static  than  dynamic.  The 
second  reason  is  that  exposure  time,  the  time  when  one  satellite  is  in 
communication  with  another  satellite,  is  relatively  small  and  reactive  protocols 
tends  to  have  much  higher  initial  overhead  in  every  exposure  period.  These  two 
factors  lead  us  to  design  a  proactive  protocol. 

The  second  major  design  decision  is  selecting  between  link-state  and  distance 
vector.  In  a  link-state  protocol  each  node  builds  a  virtual  map  of  the  entire  network, 
and  then  uses  graph  algorithms  to  select  the  best  route  through  the  network.  In  a 
distance  vector  network  each  node  only  learns  about  the  nodes  its  neighbor  can 
reach,  and  then  selects  the  best  neighbor  for  the  current  packet.  Given  the 
disconnected  nature  of  CubeSat  constellations,  we  decided  that  a  link-state  protocol 
is  more  appropriate.  It  enables  the  protocol  to  use  the  aforementioned  exposure 
predictions  in  a  straightforward  manner.  A  distance  vector  protocol  would  have 
also  resulted  in  much  higher  protocol  overhead  due  to  the  dynamic  network. 

The  link  state  table,  which  holds  the  information  necessary  for  the  routing  protocol, 
contains  more  information  than  a  traditional  link  state  protocol.  In  addition  to 
storing  details  about  which  satellites  are  within  communication  range  of  each  other, 
it  also  stores  information  that  enables  the  satellites  to  predict  when  they  will  no 
longer  be  in  range,  and  when  they  with  subsequently  fly  in  range  again. 

Since  the  link  state  information  is  reasonable  concise,  sending  it  between  satellites 
enables  each  satellite  to  predict  exposure  time  and  transmission  opportunities  for 
the  entire  network. 

Types  of  Nodes 

This  work  divides  the  responsibilities  of  network  node  into  three  different 
categories:  Low  Latency  Mule  (LLM),  High  Bandwidth  Mule  [HBM),  and  Sensor.  The 
LLM  allows  small  amounts  of  information  to  be  transmitted  between  the  Sink  and 
the  sensors.  This  is  primarily  intended  for  command  and  control  data  from  the 
ground  station  to  the  satellites.  Since  ground  station  exposure  is  small,  roughly  15- 
20  minutes  per  pass  with  only  a  few  passes  a  day,  this  connection  is  not  able  to 
transmit  large  quantities  of  data. 

The  HBM  primarily  used  for  bulk  data  transfers,  enabled  by  deploying  a  higher 
powered  and  larger  satellite  in  capable  of  higher  downlink  bandwidth.  The  primary 
use  of  the  HMB  is  to  move  large  amounts  of  payload  data,  like  images  or  complex 
data  tables,  from  sensors  down  to  Earth.  The  HBM  has  a  longer  period  between 
exposures  to  each  satellite,  but  stays  in  range  of  that  satellite  for  several  hours  each 
time.  The  HBM  will  also  have  a  much  higher  bandwidth  connection  with  the  sensors 
because  the  range  will  be  much  smaller  and  with  less  atmospheric  interference  than 
from  a  sensor  straight  to  the  ground  station.  In  addition  to  increased  bandwidth, 
this  can  also  save  power  on  the  sensor  because  each  sensor  will  be  sending  the  data 
a  shorter  distance  with  a  lower  power  radio. 
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The  HBM  will  then  relay  this  information  down  to  the  ground  station  much  faster 
than  an  individual  sensor  can.  This  is  possible  because  the  HBM  is  a  larger  satellite 
with  more  power  and  a  larger  antenna,  which  enables  it  to  achieve  higher  data  rates 
than  a  sensor  can.  In  the  case  of  the  low  earth  orbits  (LEO;  like  CubeSats),  the 
sensors  see  the  ground  station  40  minutes  a  day,  but  will  only  see  the  HBM  every 
one  or  two  months. 

The  final  type  of  node  is  the  sensor  itself.  The  sensors  can  be  gathering  any  sort  of 
data  from  the  payload  to  be  transmitted  to  the  ground  station. 

Satellite  Modes 

Each  node  in  the  network  may  be  in  one  of  three  different  modes:  discovery,  power- 
save,  and  active. 

Discovery  Mode 

Discovery  mode  is  used  to  learn  about  the  orbits  and  exposure  times  of  peer 
satellites  in  the  network.  This  mode  is  entered  immediately  after  satellite 
deployment.  In  this  mode  the  satellite  sends  out  broadcast  packets  to  discover  all  of 
the  satellites  in  the  network.  A  broadcast  packet  is  sent  periodically  until  a  node 
obtains  enough  topology  information  from  the  other  satellites.  This  requires  a 
satellite  to  pass  and  contact  to  each  other  satellite  at  least  twice  to  calculate  the 
relative  orbit  times.  Once  this  information  is  obtained  a  satellite  leaves  Discovery 
Mode  and  enters  Power-save  Mode. 

Power-Save  Mode 

Power-save  mode  is  used,  as  the  name  implies,  to  save  power  when  no 
communication  is  possible  for  a  long  time.  This  mode  is  entered  when  a  node 
determines  that  it  will  not  be  in  communication  range  with  another  satellite  for  at 
least  one  minute.  While  in  this  mode  a  satellite  will  still  respond  to  discovery  mode 
broadcast  packets,  but  will  not  generate  them.  A  satellite  leaves  power  save  mode 
and  enters  active  mode  when  it  expects  to  be  in  communication  range  of  another 
satellite  within  the  next  minute. 

Active  Mode 

Active  mode  is  used  to  exchange  both  link  state  information  and  data  packets.  A 
node  enters  active  mode  when  it  anticipates  coming  within  communication  distance 
of  another  satellite  in  the  next  minute.  Active  mode  is  further  divided  into  three 
phases:  handshake,  link  state  exchange,  and  data  exchange. 

Active  nodes  begin  in  the  handshake  phase.  During  the  handshake  phase  they 
periodically  broadcast  and  respond  to  special  handshake  packets.  Once  a  node  has 
received  a  handshake  response  from  another  satellite,  both  satellites  know  they  are 
in  communication  range  and  proceed  to  the  link  state  exchange  phase. 
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During  the  link  state  exchange  phase  the  satellites  send  the  contents  of  their  link 
state  table  to  each  other.  This  information  is  necessary  to  the  operation  of  the 
routing  protocol,  so  it  is  transferred  before  any  actual  data.  Since  this  information  is 
only  used  within  the  routing  protocol,  it  is  all  considered  protocol  overhead. 

To  minimize  this  overhead,  the  information  transmitted  during  the  link  state 
exchange  phase  is  kept  intentionally  small.  Each  satellite  has  a  unique  identifier  (a 
small  integer)  assigned  during  construction  that  is  used  to  describe  the  endpoints  of 
a  connection.  The  type  of  both  of  the  satellites  is  also  exchanged.  This  allows  the 
satellites  to  differentiate  between  sensors,  LBM,  and  HBM  so  data  can  be  routed 
through  the  most  appropriate  channel.  The  last  time  the  satellite  was  "seen"  is 
exchanged.  This  is  the  time  that  the  satellites  last  came  within  range  of  one  another 
and  started  to  communicate.  The  duration  of  the  exposure  is  exchanged  and  used  in 
conjunction  with  the  radio  bit  rate  to  calculate  the  maximum  amount  of  data  that 
can  be  transferred  during  a  connection.  The  final  piece  of  data  is  the  time  until  the 
two  satellites  will  be  in  range  again.  The  link  state  information  is  required  for 
power  save  mode  and  routing  to  work  correctly. 

After  all  the  link  state  information  has  been  exchanged  for  every  satellite  in  the 
network,  the  node  begins  the  data  exchange  phase.  In  this  phase  any  data  that  has 
been  previously  queued  the  peer  satellite  is  transmitted.  This  includes  both  data 
generated  at  the  node  and  data  the  node  has  received  and  agreed  to  forward  on 
behalf  of  another  node  in  the  network.  The  receiving  node  acknowledges  each 
packet  successfully  received,  which  facilitates  increased  reliability  in  the  network. 

The  data  exchange  phase  ends  when  the  satellites  are  no  longer  in  communication 
range.  At  that  point  the  individual  satellites  will  enter  power  save  mode  or  active 
mode  as  appropriate. 

Routing 

Routing  is  the  process  of  determining  which  path,  from  source  to  destination,  the 
data  should  take  to  traverse  the  network.  This  routing  algorithm  considers  four 
important  pieces  of  information  when  routing  a  packet:  the  type  of  packet 
(command  and  control  or  data),  the  type  of  satellite  (HBM  vs.  LBM),  the  remaining 
capacity  of  the  connection,  and  the  projected  amount  of  time  to  transmit  the  data. 
More  specifically,  the  algorithm  considers  all  possible  paths  for  the  current  data  and 
select  the  set  of  paths  that  result  in  the  data  arrive  as  soon  as  possible  at  its 
destination.  It  is  possible,  especially  if  the  quantity  of  data  to  transfer  is  large,  that 
the  data  gets  split  into  smaller  pieces  that  are  routed  independently.  This  allows  the 
real  possibility  that  each  piece  of  data  takes  a  separate  path  through  the  network. 

Simulator 

Understanding  the  performance  implications  of  a  protocol  before  deploying  it  is 
critical,  especially  in  a  network  composed  of  satellites.  As  part  of  this  work,  a 
discrete  event  simulator  was  developed  to  help  analyze  the  protocol. 
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The  simulation  engine  has  a  few  important  features  that  enable  different  scenarios. 
First,  each  satellite  in  the  simulation  is  given  its  own  three  line  element  (TLE).  TLEs 
describe  the  orbit  of  a  satellite.  There  are  a  number  of  publically  available  TLEs  for 
existing  CubeSat  satellites.  Using  actual  CubeSat  orbits  improves  the  realism  of  the 
simulations. 

The  simulation  also  provides  the  ability  to  adjust  both  the  both  the  bit  rate  and 
range  of  the  radio  used  to  communicate  between  the  satellites.  This  enables  us  to 
understand  the  minimum  performance  requirements  for  the  satellite-satellite  radio. 

The  simulator  also  includes  an  implementation  of  the  aforementioned  protocol. 
This  implementation  is  able  to  transfer  data  from  orbiting  sensor  nodes  to  the  HBM, 
measuring  the  performance  of  protocol.  The  implementation  was  also  designed  to 
be  as  separate  from  the  simulator  as  possible,  to  make  it  much  easier  to  port  to  a 
CubeSat  platform. 

Initial  Protocol  Performance 

The  first  performance  metric  analyzed  was  the  theoretical  benefit  of  using  a  satellite 
constellation  with  aggregated  downlink  capacity.  The  theoretical  results  consider 
only  the  maximum  exposure  time  in  a  year  between  a  sensor  satellite  and  both  the 
ground  station  and  a  HBM  and  the  amount  of  data  that  can  be  transmitted  during 
those  intervals.  Figure  1  shows  this  analysis: 


Figure  1 
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The  curved  lines  are  satellite-to-satellite  capacities,  while  the  straight  lines  are 
direct  to  ground  station.  The  different  lines  represent  different  radio  bit  rates.  The 
x-axis  is  the  range  of  the  satellite-to-satellite  radios.  Notice  that  a  10kbps  radio  with 
a  range  of  200km  is  the  minimum  necessary  to  improve  on  the  existing  direct-to- 
ground  station  communication. 

Figure  2  analyzes  the  overall  throughput  of  the  network  per  year,  given  a  variable 
number  of  HBM  satellites  and  fixed  radio  performance  (Imbps,  150km  range).  It 
shows  that  total  network  capacity  increases  almost  linearly  as  additional  HMBs  are 
added  to  the  network. 


Number  of  Mules 


Figure  2 

Another  important  performance  consideration  is  the  amount  of  time  it  takes  to  get 
data  back  to  earth  from  the  network.  There  are  two  considerations  here.  The  first  is 
the  time  is  takes,  and  the  second  is  the  amount  of  data  transferred.  Table  1  shows 
the  maximum  latency,  or  the  length  of  time,  until  the  data  arrives  given  one,  two, 
and  three  sensors  in  the  network. 


1  Sensor  /  1  HMB 

2  Sensors  /  1  HBM 

3  Sensors  /  1  HMB 

78  Days 

41  Days 

20  Days 

Table  1:  Maximum 


atencies  given  a  varying  number  of  sensor  nodes. 
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Figure  3 

With  only  one  sensor  talking  to  one  HBM,  78  days  occur  between  each  connection 
and  therefore  it  can  only  send  data  back  to  the  ground  station  once  every  78  days. 
The  two  and  three  sensor  times  get  drastically  better  making  the  maximum  latency 
reduce  to  a  maximum  of  20  days. 

These  results  seem  poor  when  comparing  the  protocol  to  the  maximum  latency  of 
communicating  directly  with  the  ground  station  of  one  day,  but  it  is  also  important 
to  take  into  account  the  amount  of  data  that  can  be  transferred  during  these  times. 
Figure  3  shows  the  average  amount  of  data  that  can  be  transferred  per  day 
depending  on  the  bit  rate  of  the  communication  between  the  sensors.  As  can  be 
seen  it  takes  only  a  communication  speed  of  5  kbps  in  the  worse  case  to  send  more 
data  per  day  on  average  than  is  currently  possible,  despite  the  much  larger  latency. 


Figure  3 

This  discrepancy  between  latency  and  bandwidth  underscores  the  importance  of 
classifying  data  before  sending  it.  78  days  is  too  long  for  command  and  control  data, 
but  isn’t  unreasonable  for  bulk  data. 

Future  Work 

Simulator 
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The  simulator  created  gives  a  good  idea  of  how  the  protocol  will  perform,  but  is  by 
no  means  perfect.  The  ground  station  side  of  the  simulator  is  not  yet  complete,  so 
attempting  to  measure  the  data  going  from  the  HBMs  down  to  the  ground  stations 
can  not  yet  be  tested  and  must  be  left  to  theoretical  evaluation.  This  is  an  important 
aspect  to  be  considered  before  attempting  to  build  prototypes  of  the  system  so  in 
the  next  revision  of  this  project  it  is  important  to  incorporate  this  into  the  simulator. 

Protocol 

As  in  any  new  protocol  there  are  many  places  for  improvement  and  optimization. 
Some  future  details  that  could  be  improved  include  creating  a  more  advanced 
medium  access  protocol  in  order  to  more  fully  utilize  the  available  bandwidth.  One 
such  possibility  is  to  make  the  transfer  of  data  fully  synchronized  to  further  limit  the 
number  of  collisions  and  achieve  near  100%  bandwidth  use.  The  protocol  can  also 
be  extended  to  work  with  larger  varieties  of  satellites  and  could  be  used  to  connect, 
pico  satellites,  LEO  satellites,  and  even  GEO  satellites  into  a  larger  network.  This  is 
beyond  the  scope  of  this  work,  but  would  be  an  interesting  and  beneficial  future 
addition. 

Conclusion 

In  conclusion  the  protocol  begun  by  this  work  is  a  plausible  and  effective  solution  to 
creating  a  sensor  network  in  space,  where  the  orbits  of  the  satellites  are  predictable 
and  the  density  is  sparse.  This  work  supports  these  conclusions  through  both 
theoretical  analysis  and  simulation  results.  The  preliminary  throughput  simulations 
show  improvement  over  what  is  currently  in  use  in  the  CubeSat  project. 
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Communication  within  Satellite  Constellations 

Introduction 

The  CubeSat’s  small,  standardized  form-factor  has  been  one  of  its  biggest 
assets.  It  allows  the  satellites  to  be  flown  economically,  enabling  a  myriad  of 
applications  and  experiments  that  were  previously  not  conducted  due  to  high 
launch  costs.  However,  this  same  form-factor  poses  one  of  the  biggest  engineering 
challenges  to  designing,  building,  and  deploying  CubeSats.  The  size  and  power 
constraints  that  result  from  such  a  small  enclosure  limit  the  complexity  of  the 
satellite’s  payload  and  corresponding  experiments. 

There  are  two  general  approaches  to  working  within  these  constraints.  The 
first  is  to  push  the  miniaturization  envelope,  creating  ever-smaller  payloads.  The 
second  approach  is  to  fly  multiple  satellites  in  a  constellation  (or  cluster)  that 
cooperate  with  each  other,  each  performing  a  piece  of  the  overall  mission.  To  date 
the  cluster  approach  has  been  rarely  used  with  extremely  small  satellites,  however 
the  operational  concept  is  well  known  and  discussed  amongst  CubeSat  developers. 

Current  CubeSat  communication  protocols  are  built  on  the  assumption  that 
the  ground  station  communicates  directly  with  the  satellite.  This  simplifies  protocol 
design  in  a  number  of  ways.  For  instance,  if  the  Cal  Poly  ground  station  has  a  packet 
to  send  to  a  CubeSat  (CPS),  it  simply  waits  for  CPS  to  pass  overhead  and  sends  the 
packet.  This  is  easier  than  sending  the  CPS  packet  to  the  first  satellite  that  passes 
overhead,  CP4,  and  then  depending  on  CP4  to  relay  the  packet  to  CPS.  This  relaying 
capability  is  a  fundamental  component  of  cluster  communication. 

Satellites  within  a  constellation,  especially  those  launched  in  different  P- 
PODs,  will  be  in  periodic  communication  range  of  each  other  as  determined  by  their 
orbits.  This  periodic  connectivity  requires  a  dramatically  different  routing  strategy 
than  is  employed  in  fixed,  "always  on”  connections.  Existing  CubeSat  ground 
stations  resolve  periodic  connectivity  through  the  use  of  human  operators  and 
orbital  predictions.  The  operators  use  the  predicted  time  of  the  next  pass,  prepare 
commands  for  the  satellite  in  advance,  and  then  perform  the  actual  communication 
as  the  satellite  passes  overhead.  Satellite  constellations,  on  the  other  hand,  have  no 
onboard  human  operator  responsible  for  communication.  All  the  scheduling, 
relaying,  and  routing  must  be  implemented  by  onboard  software. 

Initial  development  of  this  networking  software,  the  corresponding 
protocols,  and  the  necessary  tools  to  evaluate  them  before  flight,  was  the  focus  of 
this  work.  The  remaining  sections  in  this  report  provide  an  overview  of  the  work 
done  and  the  work  yet  to  do  in  four  important  areas,  including  how  this  work  aligns 
with  The  Office  of  Naval  Research  (ONR)  goals,  the  communication  protocol,  the 
protocol  simulator,  and  initial  protocol  analysis. 
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Alignment  with  ONR  Goals 

Satellite  constellations  can  be  used  to  solve  a  number  of  different  and  important 
problems.  The  research  in  this  proposal  is  a  fundamental  enabling  technology  for 
constellations.  This  section  describes  how  constellation  technology  could  be 
applied  to  three  different  categories  of  specific  interest  to  ONR  and  DOD:  national 
security  applications,  command  and  control  /  communication,  and  intelligence  / 
reconnaissance. 

This  work  has  two  primary  national  security  applications.  First,  a  large  part  of 
national  security  is  ensuring  that  our  critical  infrastructure  is  protected  against 
failure  when  attacked.  While  it  is  beyond  the  scope  of  this  work  to  identify  exactly 
what  constitutes  critical  infrastructure,  this  research  will  develop  and  evaluate 
different  technology  that  provides  the  most  basic  form  of  failure  protection, 
redundancy.  In  addition,  advanced  satellite  technology  is  considered  a  strategic 
advantage,  and  this  research  will  advance  the  state  of  the  art  in  satellite 
communication  technology. 

This  research  also  falls  squarely  into  the  ONR's  interests  of  command  and  control, 
computers,  and  communication.  The  broad  categories  of  computers  and 
communication  are  easily  meet  by  the  nature  of  the  research.  Specific  example 
applications  include  deploying  a  disruption  tolerant  satellite  network  that  can  carry 
mission  critical  data  securely  [command  and  control,  etc].  The  tolerance  is  obtained 
from  the  redundancy  in  the  system,  however  the  security  goal  is  not  as  obvious.  The 
underlying  technology  needs  to  be  designed  and  tested  such  that  is  operates 
correctly  even  when  under  computer-based  attacks,  like  Denial-of-Service  attacks, 
that  don't  cause  any  physical  harm  to  the  satellite. 

Finally,  the  ability  to  amortize  the  cost  of  a  single,  high  bandwidth  link  across  many 
satellites  makes  this  technology  ideal  for  intelligence,  surveillance,  and 
reconnaissance  applications  when  it  is  necessary  to  deploy  a  large  number  of 
resource  constrained  sensing  nodes  and  related  infrastructure. 

Protocol 

The  first  step  in  designing  a  routing  protocol  is  determining  the  overriding 
behavioral  categories  for  the  protocol.  These  categories  have  a  pronounced  impact 
on  the  details  of  the  design.  In  multi-hop  wireless  networks,  there  are  two  decisions 
to  make:  Should  the  protocol  be  proactive  or  reactive  and  should  the  protocol  be 
link-state  or  distance  vector. 

Proactive  protocols  determine  the  path  through  the  network  before  any  packet  is 
actually  transmitted.  This  is  used,  and  works  very  well,  in  static  networks  [like  the 
Internet]  and  multi-hop  routing  protocols  for  networks  whose  mobility  pattern 
results  in  nearly  static  networks. 

The  decision  was  made  to  use  a  proactive  protocol  for  satellite  cluster  networks 
because  of  two  factors.  First,  the  orbits  are  predictable.  The  satellites  themselves 
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can  make  high  quality  predictions  of  when  they  will  come  in  communication  range 
of  each  other.  This  makes  the  network  properties  closer  to  static  than  dynamic.  The 
second  reason  is  that  exposure  time,  the  time  when  one  satellite  is  in 
communication  with  another  satellite,  is  relatively  small  and  reactive  protocols 
tends  to  have  much  higher  initial  overhead  in  every  exposure  period.  These  two 
factors  lead  us  to  design  a  proactive  protocol. 

The  second  major  design  decision  is  selecting  between  link-state  and  distance 
vector.  In  a  link-state  protocol  each  node  builds  a  virtual  map  of  the  entire  network, 
and  then  uses  graph  algorithms  to  select  the  best  route  through  the  network.  In  a 
distance  vector  network  each  node  only  learns  about  the  nodes  its  neighbor  can 
reach,  and  then  selects  the  best  neighbor  for  the  current  packet.  Given  the 
disconnected  nature  of  CubeSat  constellations,  we  decided  that  a  link-state  protocol 
is  more  appropriate.  It  enables  the  protocol  to  use  the  aforementioned  exposure 
predictions  in  a  straightforward  manner.  A  distance  vector  protocol  would  have 
also  resulted  in  much  higher  protocol  overhead  due  to  the  dynamic  network. 

The  link  state  table,  which  holds  the  information  necessary  for  the  routing  protocol, 
contains  more  information  than  a  traditional  link  state  protocol.  In  addition  to 
storing  details  about  which  satellites  are  within  communication  range  of  each  other, 
it  also  stores  information  that  enables  the  satellites  to  predict  when  they  will  no 
longer  be  in  range,  and  when  they  with  subsequently  fly  in  range  again. 

Since  the  link  state  information  is  reasonable  concise,  sending  it  between  satellites 
enables  each  satellite  to  predict  exposure  time  and  transmission  opportunities  for 
the  entire  network. 

Types  of  Nodes 

This  work  divides  the  responsibilities  of  network  node  into  three  different 
categories:  Low  Latency  Mule  (LLM),  High  Bandwidth  Mule  (HBM),  and  Sensor.  The 
LLM  allows  small  amounts  of  information  to  be  transmitted  between  the  Sink  and 
the  sensors.  This  is  primarily  intended  for  command  and  control  data  from  the 
ground  station  to  the  satellites.  Since  ground  station  exposure  is  small,  roughly  15- 
20  minutes  per  pass  with  only  a  few  passes  a  day,  this  connection  is  not  able  to 
transmit  large  quantities  of  data. 

The  HBM  primarily  used  for  bulk  data  transfers,  enabled  by  deploying  a  higher 
powered  and  larger  satellite  in  capable  of  higher  downlink  bandwidth.  The  primary 
use  of  the  HMB  is  to  move  large  amounts  of  payload  data,  like  images  or  complex 
data  tables,  from  sensors  down  to  Earth.  The  HBM  has  a  longer  period  between 
exposures  to  each  satellite,  but  stays  in  range  of  that  satellite  for  several  hours  each 
time.  The  HBM  will  also  have  a  much  higher  bandwidth  connection  with  the  sensors 
because  the  range  will  be  much  smaller  and  with  less  atmospheric  interference  than 
from  a  sensor  straight  to  the  ground  station.  In  addition  to  increased  bandwidth, 
this  can  also  save  power  on  the  sensor  because  each  sensor  will  be  sending  the  data 
a  shorter  distance  with  a  lower  power  radio. 
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The  HBM  will  then  relay  this  information  down  to  the  ground  station  much  faster 
than  an  individual  sensor  can.  This  is  possible  because  the  HBM  is  a  larger  satellite 
with  more  power  and  a  larger  antenna,  which  enables  it  to  achieve  higher  data  rates 
than  a  sensor  can.  In  the  case  of  the  low  earth  orbits  (LEO;  like  CubeSats),  the 
sensors  see  the  ground  station  40  minutes  a  day,  but  will  only  see  the  HBM  every 
one  or  two  months. 

The  final  type  of  node  is  the  sensor  itself.  The  sensors  can  be  gathering  any  sort  of 
data  from  the  payload  to  be  transmitted  to  the  ground  station. 

Satellite  Modes 

Each  node  in  the  network  may  be  in  one  of  three  different  modes:  discovery,  power- 
save,  and  active. 

Discovery  Mode 

Discovery  mode  is  used  to  learn  about  the  orbits  and  exposure  times  of  peer 
satellites  in  the  network.  This  mode  is  entered  immediately  after  satellite 
deployment.  In  this  mode  the  satellite  sends  out  broadcast  packets  to  discover  all  of 
the  satellites  in  the  network.  A  broadcast  packet  is  sent  periodically  until  a  node 
obtains  enough  topology  information  from  the  other  satellites.  This  requires  a 
satellite  to  pass  and  contact  to  each  other  satellite  at  least  twice  to  calculate  the 
relative  orbit  times.  Once  this  information  is  obtained  a  satellite  leaves  Discovery 
Mode  and  enters  Power-save  Mode. 

Power-Save  Mode 

Power-save  mode  is  used,  as  the  name  implies,  to  save  power  when  no 
communication  is  possible  for  a  long  time.  This  mode  is  entered  when  a  node 
determines  that  it  will  not  be  in  communication  range  with  another  satellite  for  at 
least  one  minute.  While  in  this  mode  a  satellite  will  still  respond  to  discovery  mode 
broadcast  packets,  but  will  not  generate  them.  A  satellite  leaves  power  save  mode 
and  enters  active  mode  when  it  expects  to  be  in  communication  range  of  another 
satellite  within  the  next  minute. 

Active  Mode 

Active  mode  is  used  to  exchange  both  link  state  information  and  data  packets.  A 
node  enters  active  mode  when  it  anticipates  coming  within  communication  distance 
of  another  satellite  in  the  next  minute.  Active  mode  is  further  divided  into  three 
phases:  handshake,  link  state  exchange,  and  data  exchange. 

Active  nodes  begin  in  the  handshake  phase.  During  the  handshake  phase  they 
periodically  broadcast  and  respond  to  special  handshake  packets.  Once  a  node  has 
received  a  handshake  response  from  another  satellite,  both  satellites  know  they  are 
in  communication  range  and  proceed  to  the  link  state  exchange  phase. 
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During  the  link  state  exchange  phase  the  satellites  send  the  contents  of  their  link 
state  table  to  each  other.  This  information  is  necessary  to  the  operation  of  the 
routing  protocol,  so  it  is  transferred  before  any  actual  data.  Since  this  information  is 
only  used  within  the  routing  protocol,  it  is  all  considered  protocol  overhead. 

To  minimize  this  overhead,  the  information  transmitted  during  the  link  state 
exchange  phase  is  kept  intentionally  small.  Each  satellite  has  a  unique  identifier  (a 
small  integer)  assigned  during  construction  that  is  used  to  describe  the  endpoints  of 
a  connection.  The  type  of  both  of  the  satellites  is  also  exchanged.  This  allows  the 
satellites  to  differentiate  between  sensors,  IBM,  and  HBM  so  data  can  be  routed 
through  the  most  appropriate  channel.  The  last  time  the  satellite  was  "seen"  is 
exchanged.  This  is  the  time  that  the  satellites  last  came  within  range  of  one  another 
and  started  to  communicate.  The  duration  of  the  exposure  is  exchanged  and  used  in 
conjunction  with  the  radio  bit  rate  to  calculate  the  maximum  amount  of  data  that 
can  be  transferred  during  a  connection.  The  final  piece  of  data  is  the  time  until  the 
two  satellites  will  be  in  range  again.  The  link  state  information  is  required  for 
power  save  mode  and  routing  to  work  correctly. 

After  all  the  link  state  information  has  been  exchanged  for  every  satellite  in  the 
network,  the  node  begins  the  data  exchange  phase.  In  this  phase  any  data  that  has 
been  previously  queued  the  peer  satellite  is  transmitted.  This  includes  both  data 
generated  at  the  node  and  data  the  node  has  received  and  agreed  to  forward  on 
behalf  of  another  node  in  the  network.  The  receiving  node  acknowledges  each 
packet  successfully  received,  which  facilitates  increased  reliability  in  the  network. 

The  data  exchange  phase  ends  when  the  satellites  are  no  longer  in  communication 
range.  At  that  point  the  individual  satellites  will  enter  power  save  mode  or  active 
mode  as  appropriate. 

Routing 

Routing  is  the  process  of  determining  which  path,  from  source  to  destination,  the 
data  should  take  to  traverse  the  network.  This  routing  algorithm  considers  four 
important  pieces  of  information  when  routing  a  packet:  the  type  of  packet 
(command  and  control  or  data),  the  type  of  satellite  (HBM  vs.  LBM),  the  remaining 
capacity  of  the  connection,  and  the  projected  amount  of  time  to  transmit  the  data. 
More  specifically,  the  algorithm  considers  all  possible  paths  for  the  current  data  and 
select  the  set  of  paths  that  result  in  the  data  arrive  as  soon  as  possible  at  its 
destination.  It  is  possible,  especially  if  the  quantity  of  data  to  transfer  is  large,  that 
the  data  gets  split  into  smaller  pieces  that  are  routed  independently.  This  allows  the 
real  possibility  that  each  piece  of  data  takes  a  separate  path  through  the  network. 

Simulator 

Understanding  the  performance  implications  of  a  protocol  before  deploying  it  is 
critical,  especially  in  a  network  composed  of  satellites.  As  part  of  this  work,  a 
discrete  event  simulator  was  developed  to  help  analyze  the  protocol. 
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The  simulation  engine  has  a  few  important  features  that  enable  different  scenarios. 
First,  each  satellite  in  the  simulation  is  given  its  own  three  line  element  (TLE).  TLEs 
describe  the  orbit  of  a  satellite.  There  are  a  number  of  publically  available  TLEs  for 
existing  CubeSat  satellites.  Using  actual  CubeSat  orbits  improves  the  realism  of  the 
simulations. 

The  simulation  also  provides  the  ability  to  adjust  both  the  both  the  bit  rate  and 
range  of  the  radio  used  to  communicate  between  the  satellites.  This  enables  us  to 
understand  the  minimum  performance  requirements  for  the  satellite-satellite  radio. 

The  simulator  also  includes  an  implementation  of  the  aforementioned  protocol. 
This  implementation  is  able  to  transfer  data  from  orbiting  sensor  nodes  to  the  HBM, 
measuring  the  performance  of  protocol.  The  implementation  was  also  designed  to 
be  as  separate  from  the  simulator  as  possible,  to  make  it  much  easier  to  port  to  a 
CubeSat  platform. 

Initial  Protocol  Performance 

The  first  performance  metric  analyzed  was  the  theoretical  benefit  of  using  a  satellite 
constellation  with  aggregated  downlink  capacity.  The  theoretical  results  consider 
only  the  maximum  exposure  time  in  a  year  between  a  sensor  satellite  and  both  the 
ground  station  and  a  HBM  and  the  amount  of  data  that  can  be  transmitted  during 
those  intervals.  Figure  1  shows  this  analysis: 


Figure  1 
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The  curved  lines  are  satellite-to-satellite  capacities,  while  the  straight  lines  are 
direct  to  ground  station.  The  different  lines  represent  different  radio  bit  rates.  The 
x-axis  is  the  range  of  the  satellite-to-satellite  radios.  Notice  that  a  10kbps  radio  with 
a  range  of  200km  is  the  minimum  necessary  to  improve  on  the  existing  direct-to- 
ground  station  communication. 

Figure  2  analyzes  the  overall  throughput  of  the  network  per  year,  given  a  variable 
number  of  HBM  satellites  and  fixed  radio  performance  (Imbps,  150km  range).  It 
shows  that  total  network  capacity  increases  almost  linearly  as  additional  HMBs  are 
added  to  the  network. 


Number  of  Mules 


Figure  2 

Another  important  performance  consideration  is  the  amount  of  time  it  takes  to  get 
data  back  to  earth  from  the  network.  There  are  two  considerations  here.  The  first  is 
the  time  is  takes,  and  the  second  is  the  amount  of  data  transferred.  Table  1  shows 
the  maximum  latency,  or  the  length  of  time,  until  the  data  arrives  given  one,  two, 
and  three  sensors  in  the  network. 


1  Sensor /IHMB 

2  Sensors  /  1  HBM 

3  Sensors  /  1  HMB 

78  Days 

41  Days 

20  Days 

Table  1:  Maximum 


atencies  given  a  varying  number  of  sensor  nodes. 
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Figure  3 

With  only  one  sensor  talking  to  one  HBM,  78  days  occur  between  each  connection 
and  therefore  it  can  only  send  data  back  to  the  ground  station  once  every  78  days. 
The  two  and  three  sensor  times  get  drastically  better  making  the  maximum  latency 
reduce  to  a  maximum  of  20  days. 

These  results  seem  poor  when  comparing  the  protocol  to  the  maximum  latency  of 
communicating  directly  with  the  ground  station  of  one  day,  but  it  is  also  important 
to  take  into  account  the  amount  of  data  that  can  be  transferred  during  these  times. 
Figure  3  shows  the  average  amount  of  data  that  can  be  transferred  per  day 
depending  on  the  bit  rate  of  the  communication  between  the  sensors.  As  can  be 
seen  it  takes  only  a  communication  speed  of  5  kbps  in  the  worse  case  to  send  more 
data  per  day  on  average  than  is  currently  possible,  despite  the  much  larger  latency. 


Figure  3 

This  discrepancy  between  latency  and  bandwidth  underscores  the  importance  of 
classifying  data  before  sending  it.  78  days  is  too  long  for  command  and  control  data, 
but  isn’t  unreasonable  for  bulk  data. 

Future  Work 

Simulator 
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The  simulator  created  gives  a  good  idea  of  how  the  protocol  will  perform,  but  is  by 
no  means  perfect.  The  ground  station  side  of  the  simulator  is  not  yet  complete,  so 
attempting  to  measure  the  data  going  from  the  HBMs  down  to  the  ground  stations 
can  not  yet  be  tested  and  must  be  left  to  theoretical  evaluation.  This  is  an  important 
aspect  to  be  considered  before  attempting  to  build  prototypes  of  the  system  so  in 
the  next  revision  of  this  project  it  is  important  to  incorporate  this  into  the  simulator. 

Protocol 

As  in  any  new  protocol  there  are  many  places  for  improvement  and  optimization. 
Some  future  details  that  could  be  improved  include  creating  a  more  advanced 
medium  access  protocol  in  order  to  more  fully  utilize  the  available  bandwidth.  One 
such  possibility  is  to  make  the  transfer  of  data  fully  synchronized  to  further  limit  the 
number  of  collisions  and  achieve  near  100%  bandwidth  use.  The  protocol  can  also 
be  extended  to  work  with  larger  varieties  of  satellites  and  could  be  used  to  connect, 
pico  satellites,  LEO  satellites,  and  even  GEO  satellites  into  a  larger  network.  This  is 
beyond  the  scope  of  this  work,  but  would  be  an  interesting  and  beneficial  future 
addition. 

Conclusion 

In  conclusion  the  protocol  begun  by  this  work  is  a  plausible  and  effective  solution  to 
creating  a  sensor  network  in  space,  where  the  orbits  of  the  satellites  are  predictable 
and  the  density  is  sparse.  This  work  supports  these  conclusions  through  both 
theoretical  analysis  and  simulation  results.  The  preliminary  throughput  simulations 
show  improvement  over  what  is  currently  in  use  in  the  CubeSat  project. 
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Construction  of  an  Efficient  Microbial  Peptidase  Delivery  System  to  Treat  Celiac  Disease 
and  Maximize  Human  Health 

I.  Background: 

Celiac  disease  (coeliac  disease,  eeliae  sprue,  CD)  is  an  auto-immune  enteropathy  resulting  from 
sensitivity  to  epitopes  contained  within  gluten,  the  dominant  protein  portion  of  many  common 
grains  including  wheat,  barley  and  rye.  Exposure  to  these  proteins  leads  to  inflammation  and 
widespread  atrophy  of  intestinal  epithelia  in  individuals  with  CD.  Symptoms  of  CD  arc  generally 
similar  to  other  chronic  gastrointestinal  disorders  such  as  Crohn’s  disease  and  Ulcerative  colitis, 
thus  it  is  commonly  mis-diagnosed  in  both  children  and  adults  (Picarelli  ct  .al.,  2000;  Corazza, 
1996) .  While  the  symptoms  of  CD  may  be  tolerable  or  even  sub-clinical  in  some  individuals,  the 
associated  conditions  and  long-term  effects  of  unmanaged  CD  can  be  severe  or  even  fatal.  These 
include;  skin  disorders,  ulcerative  colitis,  lymphocytic  colitis,  liver  disease,  thyroid  disease, 
anemia,  diabetes,  bone  metabolism,  malignancy  and  even  neurological  and  psychological 
disturbances  (Ciclitira  et.  al.,  2005).  Since  these  grains  arc  ubiquitous  in  the  average  western 
diet,  ths  disease  greatly  detracts  from  the  quality  of  life.  The  prevalence  of  CD  is  approximately 
1 : 100  among  the  Caucasian  population,  making  it  the  most  commonly  diagnosed  chronic 
gastrointestinal  disorder  (Ciclitira  ct.  al.,  2005).  The  goal  of  this  project  is  to  develop  a  strain  of 
probiotic  lactic  acid  bacteria  that  will  colonize  the  small  intestine  and  supplement  the  intestine 
with  prolyl  peptidase  activity.  This  activity  will  allow  for  increased  break  down  and  absorption 
of  dietary  proteins  and  removal  of  potentially  harmful  metabolites. 

Rationale  for  Prolyl  Peptidase  Supplementation 

Prolinc  is  the  most  abundant  amino  acid  in  beta-casein  and  a  major  component  of  gluten.  Prolinc 
is  unique  in  that  the  amine  group  involved  in  peptide  bonding  is  covalently  bonded  to  its  side 
chain.  This  secondary  amine  produces  tight  kinks  in  protein  secondary  structure  such  that  the 
linkages  arc  resistant  to  common  digestive  enzymes.  The  result  is  an  accumulation  of  the  prolinc 
rich  peptides,  most  of  which  arc  not  absorbed  by  the  body  and  are  excreted  through  the  urine  or 
feces.  Incomplete  utilization  of  these  proteins  not  only  predisposes  people  to  the  development  of 
CD,  it  also  limits  the  nutritive  value  of  two  staples  of  the  western  diet:  milk  and  bread. 

Prolyl  Peptidases  in  Bacteria 

Prolyl  peptidase  activity  is  conspicuously  absent  from  the  human  digestive  tract.  These  enzymes 
however  can  be  found  throughout  the  microbial  community,  including  those  that  arc  residents  of 
the  human  gastrointestinal  tract.  Presently  the  most  abundant  incidence  of  prolyl  peptidase 
activity  can  be  found  in  the  genus  Lactobacillus.  Due  to  their  inability  to  synthesize  many  amino 
acids,  LABs  are  dependent  upon  extracting  their  amino  acid  requirements  from  the  environment. 
For  this  rea.son  LABs  (especially  Lactobacilli)  maintain  an  extremely  complex  and  diverse 
proteolytic  system.  Prolyl  peptidase  activity  has  already  been  characterized  in  several  species  in 
the  LAB  family  including,  Lactobacillus  helveticus,  Lactobacillus  sakei,  Lactobacillus  reuteri 
and  Lactococcus  lactis  (Degraeve  et.  al.,  2003;  Sanz  et.  al.,  2001;  Rollan  et.  al.,  2001;  Xu  et.  al. 
2001).  Prolyl  peptidase  expression  has  also  been  documented  in  bacteria  outside  of  the  LAB 
family  such  as,  Flavobacteriiim  meningosepticum,  Sphingomonas  capsulate,  Myxococcus 
xanthus  (Shan  et.  al.  2004).  Wc  have  confirmed  that  prolyl  peptidase  activity  is  present  in  several 
species  of  Lactobacillus  including  L.  helveticus,  L.  reiiteri,  L.  casei,  L.  acidophilus  and  L. 


52 


NOOOl  4-07-1-1 152 


P.l. Susan  C.  Opava,  Ph.D. 


delbruckei.  The  procedure  developed  to  assay  prolyl  peptidase  activity  uses  the  substrate  Proline- 
para-Nitroaniline  (Pro-pNA)  to  measure  proline  hydrolysis  at  the  carboxy  side  of  the  proline. 
Cleavage  at  this  site  releases  the  yellow  pNA  product  that  can  be  quantitatively  measured  by 
spectrometry  (k  =  405  nm).  We  have  observed  the  prolyl  peptidase  activity  in  lactic  acid  bacteria 
is  primarily  confined  to  the  cytoplasmic  milieu  of  the  cell.  Cell  hydrolysates  (prepared  by 
sonication)  showed  substantially  higher  prolyl  peptidase  activity  than  intact  cells  indicating  that 
very  little  prolyl  peptidase  is  secreted  into  the  extracellular  environment  (table  1).  We  will 
continue  these  experiments  on  cultures  that  demonstrated  differences  in  protein  expression  when 
grown  in  media  containing  milk  components  to  determine  if  there  is  a  correlation  between  this 
proteolytic  activity  and  the  presence  or  absence  of  supplemented  milk  components. 

Table  1:  Qualitative  and  Quantitative  Analysis  of  Ala-Pro-pNA  hydrolysis  by  cell  lysates. 


Strain 

Genus  species 

OD@ 

0  min 

15  min 

30  min 

Qualitative 

Blank 

Blank 

0.096 

0.106 

0.112 

- 

GR-1 

Lactobacillus  rhamnosus 

1.874 

1.921 

2.01 

+/- 

7469 

Lactobacillus  rhamnosus 

1.962 

2.047 

2.179 

+/- 

LC10 

Lactobacillus  easel 

1.128 

1.104 

1.092 

- 

R049 

Lactobacillus  rhamnosus 

0.878 

0.868 

0.866 

- 

MR220 

Lactobacillus  helveticus 

1.325 

1.521 

1.767 

++ 

4356 

Lactobacillus  acidophilus 

2.012 

3.313 

4 

+++  + 

23272 

Lactobacillus  reuteri 

1.927 

2.348 

2.776 

+++ 

NCK388 

Lactobacillus  helveticus 

2.118 

2.454 

3.041 

+++ 

San 

Lactobacillus  delbrueckel  ssp. 
Lactis 

0.564 

2.179 

3.115 

+  ++  + 

MR120 

Lactobacillus  delbrueckel  ssp. 
bulgaricus 

1.133 

1.492 

1.914 

+  +  + 

R011 

Lactobacillus  rhamnosus 

1.672 

1.692 

1.722 

+/- 

393 

Lactobacillus  easel 

1.462 

1.57 

1.807 

+ 

(Optical  density  measured  at  X,=405  nm) 

Probiotic  bacteria  as  enzyme  delivery  vehicles  to  manage  CD 

Bacteria  that  stabilize  the  intestinal  tract  and  promote  healthy  digestion  are  termed 
probiotic.  Although  the  term  probiotic  is  relatively  new  the  idea  of  beneficial  bacteria  is  as  old  as 
the  study  of  our  defenses  against  harmful  bacteria.  Classically,  probiotic  bacteria  are  primarily 
members  of  the  lactic  acid  family  of  bacteria  (LAB).  LABs  are  gram  positive,  non-spore  forming 
bacteria  that  produce  lactic  acid  from  the  fermentation  of  sugars.  Lactobacillus  is  the  largest 
genus  of  LABs  consisting  of  more  than  50  species  (Stiles  &  Holzapfel,1997;  Tannock,  2004). 
Lactobacilli  are  important  for  the  production  of  foodstuffs.  Most  notable  among  these  organisms 
are  Lactobacillus  delbrueckii  ssp.  bulgaricus  and  Lactobacillus  sanfranciscensis  used  in  the 
commercial  production  of  yogurt  and  sourdough  bread  respectively.  While  their  primary  role  in 
food  production  is  the  fermentation  of  sugars  to  lactic  acid,  non-commercially  important  LABs 
are  also  responsible  for  producing  a  wide  variety  of  compounds  beneficial  to  humans  including; 
anti-microbial  peptides,  exopolysaccharides  and  other  metabolites  (Ross,  Morgan  &  Hill,  2002). 

An  important  role  of  probiotic  bacteria  in  the  human  intestinal  tract  is  the  regulation  of 
intestinal  homeostasis.  This  involves  protecting  the  mucosal  epithelium  from  pathogens,  delivery 
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of  regulatory  signals  to  the  immune  system  and  neuromuscular  system,  as  well  as  inhibition  of 
pathogenic  bacteria  through  nutrient  competition,  binding  translocation  and  production  of  anti¬ 
microbial  peptides  (Shanahan,  2004).  The  genus  Lactobacillus  has  been  shown  to  be  effective  in 
the  treatment  and  prevention  of  gastrointestinal  disorders  such  as  infectious  diarrhea  and 
inflammatory  bowel  disease  (Saavedra,  2000;  Servin,  2004;  Shanahan,  2004). 

Several  of  the  bacteria  discussed  in  the  previous  section  that  possess  prolyl  peptidases  are 
able  to  colonize  the  intestines,  including  the  small  intestine.  A  bacterial  strain  that  can  colonize 
the  small  intestine  and  constitutively  express  and  secrete  prolyl  peptidase  enzymes  at  a  high  level 
of  activity  would  effectively  supplement  the  area  with  enzymes  capable  of  detoxifying  gluten. 
Furthermore,  if  a  probiotic  bacterium  such  as  those  described  above  were  used,  the  individual 
would  not  only  alleviation  of  CD  symptoms  due  to  prolyl  peptidase  activity,  but  also  enjoy  the 
health  benefits  attributed  to  intestinal  colonization  by  probiotics.  Unfortunately,  no  probiotic 
microorganism  yet  studied  expresses  prolyl  peptidase  enzymes  on  the  outer  surface  of  the  cell. 
However,  due  to  the  advancements  in  molecular  biology  technology,  it  may  now  be  possible  to 
engineer  strains  capable  of  surface  expression  of  prolyl  peptidases.  This  hypothetical  strain 
would  be  able  to  colonize  the  small  intestine  and  express  prolyl  peptidases  on  the  surface  of  the 
cell,  thus  effectively  localizing  enzyme  activity  at  the  site  of  celiac  pathology.  The  remainder  of 
this  document  describes  the  initial  research  undertaken  to  achieve  this  single  goal,  to  provide  the 
first  non-dietary  treatment  option  for  celiac  disease. 

Construction  of  S-layer  Directive  Reporter/Expression  Vectors 

The  microbial  S-layer  is  a  two-dimensional  crystalline  matrix  that  completely  covers  some 
members  of  the  Eubacteria,  and  nearly  all  members  of  the  Archaca,  domains  of  life.  One 
extensively  studied  S-layer  protein  is  the  SlpA  protein  of  Lactobacillus  acidophilus.  The  SlpA 
protein  is  eomposed  of  three  eomponents,  a  N-terminal  leader  sequenee  that  directs  secretion,  a 
crystallizing  domain  and  a  C-terminal  anchoring  domain.  The  construction  of  several  new  S- 
layer  detection  and  expression  vectors  has  begun  in  our  lab  in  order  to  assess  the  efficiency  of 
the  S-layer  extractions,  measure  induction  of  the  S-layer  promoter  system  in  Lactobacillus 
acidophilus,  and  to  express  endogenous  prolyl  peptidases  at  the  outer  surface  of  the  cell  (as  a 
fusion  with  the  S-layer  protein)  or  secreted  from  the  cell.  The  objective  in  re-localizing  these 
peptidases  to  the  exterior  of  the  eell  is  to  determine  if  the  digestion  of  proline-rich  proteins  is 
enhanced,  thus  increasing  nutrient  availability  and  destroying  potentially  harmful  immunogenic 
peptides. 

11.  Results 

Construction  of  Expression  Cassettes 

To  first  determine  the  suitability  of  the  expression  system  for  localizing  fusion  proteins,  such  as 
those  expressing  prolyl  endopeptidases,  a  green  fluorescent  reporter  was  used  to  track  the 
localization  of  the  protein.  All  components  neeessary  to  build  the  cassettes  shown  in  figure  1 
were  amplified  from  extracted  Lactobacillus  acidophilus  NCFM  genomic  DNA  (ProL,  Pro, 
Atcrm  and  Term)  or  plasmid  pMB293  (GFP)  using  the  high  fidelity  pyrococcus-like  enzyme, 
Phusion  DNA  polymerase  (Finnzymes). 
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a)  S-Iayer  expression  cassettes 


b|fapectedloc«Bi»tionofcacpfiea<edpfDtriiitlnigcto6adtoodfefcipMto 


Figure  1:  S-Iayer  GFP  expression  cassettes  and  expected  localization.  (A)  S-layer  cassette 
constructs  with  engineered  restriction  sites  for  cloning  and  replacement  of  the  GFP  reporter  with 
prolyl  peptidases  of  interest  (AscI).  (B)  the  expected  localization  of  the  fusion  protein  product 
from  each  expressed  cassette  (A)  in  L.  acidophilus. 

Digestion  independent  cloning  of  S-layer  GFP  cassettes  into  pGKMCS 

In  order  to  efficiently  clone  the  cassettes  into  pGKMCS,  a  digestion  independent  cloning  (DIG) 
technique  was  developed.  DIG  allows  for  orientation  specific  cloning  using  sequence  homology 
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between  the  insert  and  vector  (see  Figure  2).  For  DIC,  insert  and  vector  DNA  containing 
homology  at  each  end  was  mixed  together  in  a  Phusion  PCR  without  primers  and  taken  through 
5  cycles  ofdenaturation  and  extension. 


Step  1 : 
Denaturation 
98  C 


Figure  2:  Digestion  Independent  Cloning  (DIC)  of  expression  cassettes  into  suitable  shuttle 
vector  for  propagation  and  expression  in  E.coli  and  Lactobacillus  sp. 

A  relatively  high  degree  of  success  was  found  with  this  method,  allowing  the  recovery  of 
>100  potential  clones  for  each  cassette.  Recovered  clones  were  screened  by  CFU  PCR  to  identify 
those  that  contained  their  respective  inserts.  After  CFU  PCR  identified  the  clones,  they  were 
screened  for  GFP  using  fluorescence  microscopy  and  western  blot  analysis  (see  Figure  3). 
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Figure  3:  Assessment  of  expression  from  fusion  cassettes  in  E.coli.  (A)  GFP  expression 
assessed  by  fluoreseenee  mieroseopy  for  plasmids  earrying  PLGAT,  PLGT,  PGAT,  and  PGT. 

(B)  Western  blot  analysis  of  expression  eassettes  using  anti-GFP  antibodies.  Expeeted  sizes  for 
eaeh  product  are:  GFP(+)  from  yeast  expression  plasmid  =  52.8kD;  PGT  =  27kD;  PLGT  =  31kD; 
PGAT  =  40kD;  PLGAT  =  45kD. 

In  order  to  be  able  to  discern  possible  reasons  why  PLGAT  is  not  expressed  in  E.  coli  and 
some  of  the  expression  cassettes  had  limited  fluorescence  under  the  microscope,  the  inserts  from 
three  plasmids  pGKMCS:PLGAT,  pGKMCSiPLGT  and  pGKMCS:PGT  were  sequenced. 
Sequencing  results  for  the  PLGAT  cassette  showed  a  frameshift  deletion  of  two  nucleotides  at 
places  347  and  348  .  The  PLGT  cassette  acquired  a  single  nucleotide  deletion  resulting  in  a 
frame-shift  mutation  at  nucleotide  352.  For  the  available  sequence,  the  PGT  insert  appeared  to  be 
as  expected,  however,  poor  sequence  data  was  obtained  for  the  5’  end  of  each  insert,  including 
the  sigma  factor  binding  sites. 

This  investigation  has  yielded  the  successful  construction  of  a  broad  host  range  shuttle 
vector  with  a  robust  multiple  cloning  sequence  to  allow  relatively  easy  cloning  and  expression  of 
DNA  in  Lactobacillus  and  other  organisms  in  which  the  pGK12  plasmid  will  replicate.  This 
work  has  also  revealed  toxicity  of  unknown  origin  which  resulted  in  the  acquisition  of  mutations 
in  the  inserts,  despite  the  fact  that  a  proofreading  polymerase  was  used  for  each  amplification. 
Furthermore,  we  have  developed  a  novel  cloning  technique,  which  once  optimized,  may  allow 
for  direct  cloning  of  these  cassettes  into  Lactobacillus,  thus  bypassing  the  toxicity  problem  in  E. 
coli.  While  it  is  likely  that  the  anchor  sequence  plays  a  role  in  this  toxicity,  it  cannot  be  the  sole 
culprit  as  the  PLGT  insert  was  also  mutated.  Until  it  is  determined  whether  or  not  DIG  can  be 
utilized  for  this  application,  inducible  expression  systems  for  E.  coli  was  developed  to  prevent 
selection  for  mutants  during  cloning  and  allow  for  analysis  of  the  slpA  localization  signals  in 
both  organisms. 

Development  of  an  Inducible  Expression  System  to  Evaluate  Fusion  Protein  Toxicity 

Inducible  plasmid-based  expression  systems  are  often  used  to  allow  expression  of  inserts  that 
may  be  toxic  to  their  host.  The  previous  section  has  shown  that  the  expression  and/or  localization 
signals  derived  from  the  slpA  gene  of  Lactobacillus  acidophilus  NCFM  arc  toxic  in  E.  coli, 
leading  to  the  inability  to  recover  clones  bearing  the  expected  inserts.  In  order  to  be  able  to 
effectively  assess  the  efficacy  of  using  the  slpA  localization  signals  to  guide  surface  layer 
expression  of  prolyl  peptidase  activity,  we  selected  the  E.  coli  expression  system,  pET30,  which 
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exploits  the  IPTG  controlled  expression  to  provide  easily  inducible  expression  of  heterologous 
proteins.  The  current  investigation  describes  the  utilization  of  pET30  based  plasmids  to  assess 
the  viability  of  using  slpA  signals  to  drive  prolyl  peptidase  localization  in  E.  coli. 

Initially,  two  pET30  based  plasmids  were  constructed  using  the  SlpA  leader  (“L”),  a 
truncated  version  of  the  original  SlpA  anchor  sequence  (“S”),  and  the  Xaa-prolyl  peptidase  from 
L.reuterii  (“X”),  named  pET30:LS  and  pET30:LXS.  In  order  to  determine  if  toxicity  is 
associated  with  either  insert,  growth  was  monitored  after  induction  with  IPTG.  The  pET30:LS 
plasmid  showed  a  significant  halt  in  growth  after  15  minutes  of  induction  and  even  a  slight  drop 
in  OD600  after  1 .5  hours  compared  to  the  uninduced  control  (see  Figure  4).  Interestingly,  the 
pET30:LXS  only  exhibited  only  a  small  degree  of  growth  impairment  when  compared  to  the 
uninduced  control. 
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Figure  4:  Assessment  of  toxicity  associated  with  the  SlpA  leader  and  anchor  sequences. 
Growth  curves  from  E.coli  harboring  the  pET30:LS  or  pET30:LXS  plasmids.  OD600 
measurements  were  taken  every  1 5  minutes  from  cultures  either  induced  with  IPTG  or  not. 

The  two  pET30  plasmids  were  built  in  such  a  manner  as  to  preserve  the  downstream  His- 
tag  as  part  of  the  inducible  open  reading  frame,  thus  allowing  for  determination  of  full  length 
expression  of  the  inserts  by  detection  of  the  His-tag  using  western  blot.  The  His-probe  analysis 
showed  full-length  LXS  expression  (101.1  kD)  localized  to  the  insoluble  pellet  fraction  of  the 
cell  lysate.  Expression  of  LS  (12.7  kD)  was  much  lower  and  was  also  localized  to  the  pellet 
fraction  (see  Figure  5).  No  peptidase  activity  could  be  detected  in  whole  cell  lysates  prepared 
from  the  induced  pET30:LXS  cultures  despite  the  evidence  of  full-length  expression  of  the  insert 
by  His-tag  detection  (data  not  shown). 
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Figure  5:  Localization  of  LS  and  LXS  in  E.coli.  The  C-tcrminal  His-tag  of  the  1 .5-hour 
indueed  gene  produets  from  eells  harboring  pET30;LS  and  pET30;LXS.  L  =  lysate,  S  =  cell 
supernatant  (medium),  P  =  insoluble  pellet  from  lysate.  Molecular  weight  standards  (from 
bottom  to  top):  15kD,  25kD,  35kD,  50kD,  75kD,  lOOkD,  150kD.  Expected  sizes:  LS  =  12.7kD, 
LXS=  lOlkD. 

To  further  investigate  the  possibility  that  these  fusions  were  localized  to  inclusion  bodies 
in  the  cells,  induced  cultures  were  examined  by  light  microscopy.  Distinctive  morphological 
differences  were  observed  between  induced  cultures  of  E.  coli  harboring  pET30:LXS  and 
uninduced  cultures.  Induced  cultures  showed  drastically  elongated  cellular  morphology  with 
irregular  staining.  Uninduced  cultures  displayed  the  individual  1  uM  by  2  uM  rods  characteristic 
off.  coli  (see  Figure  6). 


UhMuomI 


Figure  6:  Morphological  characteristics  of  induced  vs.  uninduced  cultures.  The  presence  of 
inclusion  bodies  were  clearly  visible  in  the  pET30:LXS  plasmid-bearing  strain  upon  IPTG 
induction. 
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III.  Discussion: 

The  extremely  well  eharaeterized  pET30  expression  system  allowed  for  the  eontinued 
investigation  of  the  potential  for  using  slpA  secretion  and  anchoring  signals  in  fusion  with 
peptidase  genes  to  drive  localization.  The  examination  of  these  gene  fusion  products  in  E.  coli 
was  undertaken  to  provide  conceptual  evidence  for  the  experimental  design.  The  pET30:LS 
plasmid  played  a  dual  role  in  this  investigation.  This  expression  vector  was  initial  constructed  as 
a  negative  control  to  be  used  in  the  pET30:LXS  peptidase  activity  assays,  however  it  also 
allowed  for  direct  assessment  of  toxicity  associated  with  the  S-layer  localization  components. 
Upon  induction  with  IPTG  the  pET30:LS  culture  displayed  no  growth  after  15  post-induction. 
This  observation  provides  undeniable  evidence  that  the  slpA  leader  and/or  anchor  are  extremely 
toxic  in  E.  coli.  The  observed  growth  characteristics  are  consistent  with  the  murein  hydrolase 
activity  previously  prescribed  to  the  full  size  anchor,  but  was  thought  to  have  been  abolished  by 
replacement  of  this  component  with  the  truncated  anchor. 

It  was  interesting  to  observe  the  distinctive  difference  in  toxicity  between  the  LS  insert 
and  the  LXS  insert.  There  were  three  possible  explanations  for  the  attenuated  toxicity  associated 
with  LXS  as  compared  to  LS: 

1)  The  full-length  LXS  cassette  may  not  be  expressed  in  E.  coli.  It  was  possible  that  the 
Xaa-Pro  peptidase  derived  from  L.  reuteri  may  not  be  expressed  in  E.  coli  due  to  codon 
bias  associated  with  the  coding  region  of  this  gene.  If  a  rare  codon  was  used  in  this  open 
reading  frame  then  this  might  lead  to  truncation  in  E.  coli  and  thus  effectively  delete  the 
anchor  domain  from  the  gene  product.  If  the  anchor  were  indeed  the  source  of  toxicity, 
then  this  would  abolish  the  lethal  effects  of  this  protein.  In  order  to  determine  if  this  was 
the  case,  HRP  conjugated  NTA  was  used  to  probe  for  the  C-terminal  His-tag.  Since  the 
cloning  scheme  allowed  for  only  the  C-terminal  His-tag  of  the  pET30  expression  vector 
to  be  in  frame  with  the  recombinant  protein,  only  full  length  proteins  would  be  detected 
using  this  method.  The  blot  clearly  shows  evidence  of  expression  of  the  entire  insert 
yielding  the  expected  101.1  kD  protein  (Figure  3-4).  Therefore,  truncation  cannot  be  the 
explanation  for  decreased  toxicity  associated  with  this  insert  as  compared  to  LS. 

2)  LXS  is  aggregating  to  form  inclusion  bodies  in  the  cytoplasm  of  E.  coli,  thus  is  not 
able  to  elicit  its  toxic  effects  in  the  periplasmic  space.  This  hypothesis  may  be 
supported  by  observed  differences  in  cellular  morphology  between  induced  and 
uninduced  LXS  cultures.  The  induced  culture  showed  drastically  different  morphology 
and  contained  what  may  be  inclusion  bodies  within  the  cells.  Meanwhile  the  induced  LS 
cells  showed  no  morphological  differences  from  the  uninduced  control  (Figure  3-5).  The 
His-tag  probe  results  may  also  support  this  assertion,  as  the  vast  majority  of  protein  was 
associated  with  the  insoluble  cell  lysate  pellet.  By  definition,  inclusion  bodies  are 
comprised  of  insoluble  protein  aggregates  and  would  therefore  localize  to  the  pellet 
fraction  after  cell  lysis  and  centrifugation.  An  alternative  explanation  for  the  presence  of 
the  expressed  protein  in  the  insoluble  fraction  is  that  the  anchor  is  functioning  properly  in 
E.  coli  and  is  anchoring  within  peptidoglycan  layer  of  this  organism.  If  the  protein  is 
being  expressed  as  an  inclusion  body  the  enzyme  may  still  be  able  to  be  purified,  re¬ 
solubilized  and  re-folded  to  determine  enzymatic  activity.  Also,  the  concentration  of 
IPTG  used  for  induction  could  be  dropped  in  order  to  achieve  a  level  of  induction  that  is 
not  high  enough  to  promote  aggregation. 
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3)  The  Xaa-Pro  domain  abolishes  the  toxicity  associated  with  the  other  domains.  The 
peptidase  domain  of  the  fusion  protein  may  result  in  the  inability  of  the  leader  peptide  to 
be  recognized  or  properly  processed  in  E.  coli  leading  to  lack  of  secretion,  which  may 
ease  the  toxic  affects  of  the  insert.  Analagously,  if  toxicity  is  associated  with  the  anchor 
domain  then  the  peptidase  domain  may  result  in  a  conformation  that  abrogates  any 
catalytic  activity  associated  with  this  domain.  Thus  leading  to  attenuated  toxicity  when 
compared  to  LS.  Unfortunately,  the  current  study  could  not  address  how  the  Xaa-Pro 
domain  influences  the  S-layer  signals. 

It  is  worth  noting  that  while  possibility  one  described  above  can  be  discounted, 
possibilities  two  and  three  are  not  mutually  exclusive  and  both  may  be  partially  responsible  for 
the  lack  of  toxicity  observed  after  induction  of  LXS.  In  order  to  properly  assess  these  affects  as 
well  as  the  exact  source  of  toxicity  in  E.  coli  (Leader  or  Anchor  or  both),  new  plasmids  allowing 
for  every  possible  permutation  of  these  components,  are  currently  being  built.  These  new 
plasmids  (pET30;LX,  XS,  X,  L,  and  S)  would  not  only  allow  for  the  determination  of  the  exact 
source  of  toxicity  in  E.  coli  but  would  also  provide  insight  into  the  reason  why  there  is  no  Xaa- 
Pro  peptidase  activity  detectable  in  induced  pET30:LXS  cultures  whole  cell  lysates.  The  lack  of 
peptidase  activity  may  be  a  result  of  at  least  two  possibilities.  The  peptidase  domain  may  not  be 
able  to  fold  correctly  when  fused  to  the  leader  and/or  anchor  components,  and  /or  this  protein 
may  require  cellular  components  not  present  in  E.  coli  that  are  required  for  protein  folding  or 
enzymatic  activity.  Furthermore  it  is  likely,  based  on  microscopic  and  His  probe  analysis  that 
aggregates  of  LXS  form  inclusion  bodies,  which  are  unlikely  to  show  activity.  Construction  and 
analysis  of  the  aforementioned  vectors  would  allow  for  progress  to  be  made  toward 
understanding  what  exactly  is  curtailing  peptidase  activity  in  the  present  study  and  may  elucidate 
a  solution  to  this  problem. 

IV.  Concluding  Remarks  and  Future  Goals; 

The  work  described  herein  provides  a  solid  technological  foundation  for  the  genetic 
engineering  of  Lactobacilli.  Among  these  advancements  is  the  construction  of  an  E.  coli- 
Lactohacillus  shuttle  vector  with  a  robust  MCS  as  well  as  general  procedures  describing 
molecular  techniques  optimized  for  these  bacteria.  A  notable  achievement  is  the  development  of 
a  novel  method  of  digestion  independent  cloning  (DlC),  which,  once  fully  characterized  may 
allow  for  direct  cloning  of  cassettes  into  Lactobacillus.  This  research  also  highlighted  the  unique 
difficulties  inherent  within  a  non-model  system.  Incompatibility  between  the  Lactobacillus 
derived  localization  components  and  the  E.  coli  cloning  host  in  this  study  resulted  in  the  inability 
to  recover  the  desired  shuttle  plasmids  and  resulted  in  a  significant  amount  of  lost  time  and 
resources.  In  order  to  prevent  this  same  mistake  from  occurring  again,  a  three  stage  experimental 
plan  has  been  developed. 

Stage  1:  Characterization  of  all  components  in  the  E.  coli  model.  This  initial 
investigation  will  allow  for  preliminary  conceptual  evidence  for  the  utilization  of  prolyl 
peptidases  to  hydrolyze  immunogenic  peptides  when  fused  to  secretion  and  anchoring  signals. 

Stage  2:  Determination  of  the  functionality  of  S-layer  localization  components  in  the 
intenuediate  host,  L.  acidophilus.  This  stage  utilizes  the  organism  from  which  the  S-layer 
components  were  originally  isolated  to  determine  if  they  are  still  functional  when  expressed  in 
recombinant  form  and  fused  to  the  peptidase. 
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Stage  3:  Assess  the  efficacy  in  the  destination  organism,  L.  rent  eh.  The  final  stage  will 
ascertain  whether  or  not  a  bacterial  prolyl  peptidase  delivery  vehicle  is  a  viable  treatment  option 
for  CD. 

By  following  this  experimental  design,  future  research  is  expected  to  be  more  likely  to 
succeed.  In  this  investigation,  it  is  likely  that  the  toxicity  witnessed  in  the  cloning  host  is  a  result 
of  fundamental  differences  between  the  cellular  physiology  of  these  organisms  that  are  not  yet 
completely  understood.  Indeed  the  exact  function  of  the  SlpA  protein  in  Lactobacillus 
acidophilus  has  not  yet  been  completely  defined. 

This  underscores  a  fundamental  limitation  imposed  by  the  nature  of  applied  genetic 
research.  The  genomic  revolution  has  provided  an  incredible  wealth  of  information  from  a  vast 
number  of  organisms  with  extremely  diverse  ancestry.  The  challenge  of  sifting  through  this 
information  and  effectively  mining  the  data  for  products  that  may  be  of  therapeutic  importance  is 
laid  upon  the  shoulders  of  researchers  in  the  post-genomic  era.  The  step-wise  approach  described 
above  provides  a  framework  for  investigators  in  this  field.  While  the  exact  stages  will  differ 
depending  on  the  specific  goal,  it  is  important  to  be  able  to  move  through  models  to  prevent  the 
over  pursuance  of  false  leads  and  maintain  a  steady  course  towards  the  final  goal. 

This  ongoing  research  presented  in  this  report  aims  to  create  an  entirely  new  form  of 
treatment,  not  only  for  celiac  disease  but  other  disorders  in  which  enzyme  supplementation 
through  commensal  microorganisms  might  be  useful.  This  goal  represents  a  paradigm  shift  in  the 
way  scientists  view  the  human  body.  It  is  no  longer  seen  as  a  collection  of  discrete  parts  that 
make  up  a  whole,  but  as  a  single,  integrated  biological  system  in  which  microorganisms  play  a 
fundamental  role. 
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Building  a  laboratory  to  investigate  injury-repair  in  skeletal  muscle  and  its  vasculature 

The  long-term  goal  of  my  research  program  is  to  participate  in  the  development  of  molecularly- 
targeted  therapeutic  strategies  for  patients  with  injury  or  disease  in  the  peripheral  limbs.  Example 
injuries  of  the  peripheral  limb  include  muscle  strains  or  bone  fractures  while  example  diseases  of  the 
peripheral  limbs  include  peripheral  artery  disease,  osteoporosis,  or  sarcopenia.  This  research  effort 
also  has  important  implications  for  the  possibility  of  limb  regeneration,  as  injury-repair  involves 
cellular  processes  that  are  similar  to  those  that  control  limb  development  in  the  embryo.  The  role  that 
we  will  play  in  this  overall  effort  towards  more  personalized  treatments  for  these  injuries  and 
diseases  is  in  advancing  the  understanding  of  the  molecular  regulation  of  injury-repair.  Specifically, 
we  are  interested  in  how  blood  vessel  function  is  affected  by  injury  and  disease.  The  blood  vessels 
we  are  most  interested  in  are  the  small  arteries  and  arterioles,  whose  primary  function  is  to  regulate 
tissue  blood  flow  through  changes  in  their  diameter-  a  process  known  as  vasoactivity.  Although  it  is 
well  known  that  injury-repair  in  skeletal  muscle  of  the  limb  is  associated  with  impaired  vasoactivity, 
the  molecular  mechanism  (i.e.  the  proteins)  underlying  this  impairment  is  poorly  understood.  This  is 
critical  because  tissues  will  not  function  properly  without  sufficient  oxygen  delivery  by  blood. 

Given  the  critical  role  of  blood  flow  control  in  maintaining  normal  tissue  function,  the  original  goals 
of  this  proposal  were  to  better  understand  the  impact  of  injury-repair  on  vasoactivity  and  skeletal 
muscle  function  by  defining  the  tissue  conditions  associated  with  impaired  vasoactivity  and  reduced 
skeletal  muscle  function  using  a  chronic  ischemia  (insufficient  blood  flow  due  to  arterial  occlusion) 
model  of  injury-repair.  Preliminary  data  indicated  that  impaired  functional  hyperemia  is  not  a 
ubiquitous  feature  of  ischemia,  but  occurs  only  in  those  muscles  that  are  hypoxic  (low  02)  or  contain 
recently  grown  blood  vessels.  Therefore,  the  objectives  of  this  research  are  to: 


1 .  Determine  the  effects  of  hypoxia  and  angiogenesis  (growth  of  new  capillaries)  on 
vasoactivity. 

2.  Determine  the  effects  of  hypoxia  and  angiogenesis  on  muscle  force  production. 

3.  Characterize  the  hypoxic,  angiogenic,  and  muscle  regeneration  response  to  ischemic  injury  in 
previously  un-described  skeletal  muscles  in  the  hindlimb 

These  experiments  will  further  our  understanding  of  the  specific  aspects  of  ischemia  that  cause 
impaired  vasoactivity  and  skeletal  muscle  function  and  thus  provide  the  foundation  for  future 
investigations  directed  towards  uncovering  the  specific  proteins  underlying  these  impairments. 
However,  the  focus  of  this  project  was  solely  to  acquire  some  of  the  necessary  equipment  and 
supplies  to  enable  this  research  and  did  not  involve  actual  experimentation. 

Background  &  Significance 

The  ability  for  skeletal  muscle  to  increase  its  blood  supply  during  contraction  (termed  functional 
hyperemia)  is  impaired  during  injury-repair)  [1]  and  disease  (e.g.  obesity,  hypertension,  diabetes,  etc) 
[2].  This  observation  is  significant  because  skeletal  muscle  function  is  required  for  many  essential 
activities,  such  as  postural  maintenance  and  locomotion.  Muscle  contraction  lasting  longer  than 
several  seconds  requires  an  increase  in  O2  delivery  to  support  the  elevated  metabolism.  The  increased 
O2  delivery  is  primarily  mediated  by  increased  blood  flow  through  resistance  vessel  vasodilation 
(increase  in  blood  vessel  diameter),  which  as  stated  above,  is  impaired  during  a  wide  variety  of 
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injury-repair  and  disease  states. 

Although  impaired  functional  hyperemia  during  injury-repair  and  disease  are  well  described  in  rats 
[3],  rabbits  [4],  and  humans  [5],  the  proteins  responsible  for  this  impairment  are  not  known. 
Understanding  the  molecular  mechanism  (i.e.  the  proteins)  underlying  this  impairment  is  necessary 
for  the  development  of  specific,  efficacious,  and  personalized  therapies  designed  to  restore  functional 
hyperemia  during  injury-repair  and  disease.  Presently,  impaired  functional  hyperemia  in  patients 
(who  present  with  symptoms  of  intermittent  claudication,  or  pain  in  the  legs  during  walking)  is 
treated  with  exercise,  dietary  changes,  and/or  pharmacologic  agents  that  are  prescribed  on  a  largely 
trial  and  error  basis  [6]. 

Therefore,  to  improve  the  specificity  and  effectiveness  of  injury  rehabilitation  and  disease  treatment, 
the  goal  of  rny  research  program  is  to  uncover  the  proteins  that  cause  the  impairment  in  functional 
hyperemia  during  injury-repair  and  disease.  The  first  step  towards  achieving  this  goal  is  to  expand 
upon  previous  research  in  this  area  by  describing  the  effects  of  injury-repair  on  functional  hyperemia 
in  the  mouse.  The  importance  of  this  step  lies  in  the  fact  that  mice  are  the  only  research  animals 
routinely  available  for  genetic  manipulation-  targeted  genetic  disruption  and  transgenesis.  Targeted 
genetic  dismption  describes  the  removal  of  a  specific  gene  from  the  mouse  genome  while 
transgenesis  is  a  technique  used  to  enhance  the  expression  of  a  specific  gene.  Using  animals 
developed  with  these  genetic  manipulations,  I  plan  to  determine  the  role  of  specific  gene  products 
(proteins)  in  modulating  functional  hyperemia  during  injury-repair  and  disease.  However,  because 
thousands  of  the  -30,000  genes  present  in  the  mouse  genome  are  expressed  in  skeletal  muscle, 
genetic  manipulation  cannot  be  the  sole  experimental  approach  used  to  uncover  the  gene  products 
causing  impaired  functional  hyperemia  during  injury-repair.  Viz.,  it  is  not  practical  to  selectively 
modify  (remove  or  over-express)  every  gene  present  in  skeletal  muscle  until  we  find  one  that  causes 
the  impaired  functional  hyperemia  observed  during  injury  repair  and  disease. 


Therefore,  wc  will  start  the  process  of  identifying  candidate  proteins  involved  in  vasodilatory 
dysfunction  by  assessing  the  anatomical,  physiological,  and  biochemical  impact  of  injury-repair  on 
vascular  function  tissue  under  different  experimental  conditions.  Completing  this  first  step  will 
allow  us  to  define  the  specific  features  of  injury-repair  that  lead  to  impaired  functional  hyperemia. 

For  this  research,  we  are  interested  in  identifying  the  particular  aspects  of  ischemic  injury  (induced 
by  interrupting  arterial  blood  flow)  that  cause  a  reduced  skeletal  muscle  blood  flow  response  during 
muscle  contraction. 

To  determine  the  effect  of  ischemic  injury  on  functional  hyperemia,  we  will  use  chronic  hindlimb 
ischemia  in  young,  healthy  mice  as  a  model  of  injury-repair.  In  addition  to  modeling  acute,  traumatic 
injury,  hindlimb  ischemia  also  serves  as  a  simplified  model  of  peripheral  artery  disease-  therefore  the 
results  from  this  work  will  provide  the  foundation  for  future  research  directed  towards  understanding 
the  mechanisms  underlying  impaired  functional  hyperemia  in  more  complex  human  disease  models, 
e.g.  aged  mice  with  hypercholesterolemia. 

Two  different  models  of  chronic  hindlimb  ischemia  will  be  employed;  both  models  involve 
interrupting  blood  flow  through  the  femoral  artery  (Figure  1),  which  injures  the  limb  and  causes 
muscle  fiber  death  due  to  diminished  oxygen  and  nutrient  delivery.  The  subsequent  repair  process 
involves  both  muscle  fiber  regeneration  and  vascular  growth.  These  two  models  allow  us  to  examine 
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the  effects  of  different  injurious  stimuli  and  a  variety  of  repair  processes. 


Resection  model 


Figure  1.  Hindlimb  ischemia  diagrams 

For  example,  in  the  ligation  model,  a  single  ligation  (tie  off  with  suture)  will  be  made  in  the  femoral 
artery  in  the  thigh  (Figure  1,  top).  This  ligation  results  in  collateralization  (outward  growth  of 
arteries  and  arterioles)  in  the  thigh  and  hypoxia  in  the  calf  (Figure  2)  and  allows  us  to  examine  how 
two  injurious  stimuli-  hypoxia  and  ischemia  as  well  as  the  collateralization  aspect  of  tissue  repair 
affect  skeletal  muscle  physiology.  In  the  resection  model,  a  long  segment  of  the  femoral  artery  will 
be  resected  (removed)  from  the  hindlimb  (Figure  1,  bottom).  This  resection  results  in  hypoxia  and 
angiogenesis  (growth  of  new  capillaries)  in  the  calf  (Figure  3),  allowing  us  to  examine  the  injurious 
stimuli  of  hypoxia  and  ischemia,  as  well  as  how  microvascular  growth  affects  functional  hyperemia 
during  repair. 

Additionally,  different  muscles  in  each  of  these  models  contain  different  muscle  fiber  types  and  also 
undergo  differing  levels  of  injury  and  subsequent  regeneration.  This  heterogeneous  response 


69 


NOOO 14-07- 1-1 152 


P.l. Susan  C.  Opava.  Ph.D. 


provides  us  an  opportunity  to  examine  the  influence  of  muscle  fiber  properties  on  the  repair  process, 
as  well  as  on  physiological  function  following  repair.  For  example,  muscles  with  different  fiber  types 
or  that  undergo  differing  levels  of  fiber  damage  may  also  experience  differing  levels  angiogenesis  or 
impairments  to  blood  flow. 

Using  these  two  models,  we  will  disscet  the  contribution  of  different  aspects  of  the  repair  process  on 
impaired  functional  hyperemia  and  muscle  force  production. 


A.  iliaca  extema 


A.  femoralis 


Arleria 

^  profunda-^ 
femoris 


2 


Figure  2.  Collateral  arteries  fonning  after  ligation  surgery 


For  example,  if  functional  hyperemia  to  the  calf  is  impaired  only  in  the  resection  model,  then  we  will 
have  learned  that  angiogenesis  during  repair  is  an  important  contributor  to  reduced  functional 
hyperemia,  and  the  injurious  stimulus  of  hypoxia  docs  not  substantially  affect  blood  flow  control. 


In  summary,  the  long-term  goal  of  my  research  program  is  to  identify  the  proteins  responsible  for 
impaired  skeletal  muscle  function  during  ischemic  injury-repair  and  disease.  Using  the  equipment 
purchased  through  this  project,  wc  will  be  able  to  take  the  initial  steps  towards  achieving  this  goal  by 
using  a  combination  of  physiological,  anatomical,  and  biochemical  assessments  to  determine  the 
impact  of  ischemic-injury  on  vascular  function. 
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figure  3.  Capillary  formation  in  calf 
cross  section  (angiogenesis,  brown 
^ots)  following  resection  surgery 
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The  results  of  this  research  may  result  in  the  identification  of  target  proteins  involved  in  modulating 
skeletal  muscle  function  during  injury-repair  and  disease,  thus  providing  targets  for  specific 
biotechnology  and  biomedical  engineering-based  therapeutic  and  rehabilitation  strategies. 
Additionally,  the  results  from  this  work  are  relevant  to  the  Office  of  Naval  Research  with  respect  to 
the  recovery  of  soldiers  from  traumatic  injury.  By  understanding  the  proteins  that  affect  proper 
functioning  in  repairing  tissues,  specific  therapies  can  be  designed  to  enhance  the  recovery  of 
soldiers  with  injuries  that  affect  peripheral  limb  function  by  activating  those  proteins  involved  in 
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restoring  proper  physiological  function,  or  conversely  by  inhibiting  those  proteins  involved  in 
impairing  physiological  function.  Furthermore,  in  addition  to  providing  targets  for  biotechnology- 
based  therapeutics,  understanding  the  proteins  involved  in  mediating  normal  peripheral  function  will 
also  provide  targets  for  gauging  the  effectiveness  of  physical  therapies,  such  as  exercising  training,  at 
the  molecular  level.  Thus,  identifying  the  proteins  involved  in  modulating  skeletal  muscle  functional 
hyperemia  will  allow  the  development  of  specific  exercise-training  regimens  that  utilize  or  arc  based 
on  biomarkers  (mRNA  or  proteins)  to  assess  fitness  and  training  program  effectiveness. 

Infrastructure  Development  &  Equipment  Use 

The  first  major  piece  of  equipment  that  1  was  able  to  purchase  through  this  award  is  a  micropressure 
system  (Figures  4  &  5).  The  purpose  of  the  micropressure  system  is  to  measure  blood  pressure  in 
blood  vessels  that  are  too  small  to  catheterize  with  a  fluid-filled  polymer  catheter  (typically  vessels 
less  than  300|im  in  diameter).  The  micropressure  system  is  composed  of  three  main  components-  a 
glass  microelectrodc,  a  pressure  regulator,  and  an  amplifier/signal  processor  (main  unit).  The 
microelectrode  (a  glass  capillary  tube  heat-stretched  to  a  tip  diameter  of  l-3|im)  is  filled  with  a 
eoneentrated  eleetrolyte  solution  (e.g.  3M  KCl)  that  has  a  very  low  resistance  to  current  flow.  This 
resistance  is  continuously  monitored  by  the  main  unit. 


Figure  4.  Micropressure  system  main  unit 
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Figure  5.  Micropressure  system 


Once  the  microelectrode  is  placed  inside  a  blood  vessel,  the  hydrostatic  pressure  of  blood  will  cause 
isotonic  plasma  to  enter  the  electrode  tip.  The  entry  of  plasma  into  the  electrode  tip  will  increase  the 
resistance  to  current  flow  as  it  dilutes  the  concentrated  electrolyte  solution  within  the  microelectrode. 
This  change  in  resistance  is  detected  by  the  main  unit,  which  then  signals  to  the  pressure  regulator  to 
increase  pressure.  The  pressure  regulator  is  connected  to  both  positive  and  negative  pressure  sources 
(Figure  5);  if  an  increase  in  current  resistance  as  measured  by  the  main  unit  (due  to  entry  of  plasma 
into  the  electrode  tip),  it  will  signal  the  pressure  regulator  to  increase  the  net  pressure  it  allows  to 
pass  to  the  microelectrode  by  increasing  the  electrodes’  exposure  to  the  positive  pressure,  decreasing 
the  electrodes’  exposure  to  the  negative  pressure  source,  or  both.  This  net  pressurization  of  the 
electrode  will  force  the  isotonic  plasma  back  out  of  the  microelectrode  tip  and  return  the  current 
resistance  back  to  its  low,  baseline  level.  The  arterial  pressure  is  then  determined  as  the  net  pressure 
(applied  to  the  microelectrode  by  the  pressure  regulator)  required  to  maintain  low  current  resistance 
(i.e.  prevent  plasma  entry)  in  the  microelectrode. 


Blood  flow  is  determined  by  both  the  resistance  of  a  vascular  network  and  the  pressure  gradient 
across  the  vascular  network.  We  were  previously  able  to  measure  blood  flow  and  vessel  diameter 
(the  main  contributor  to  resistance).  Using  this  methodology  we  will  now  be  able  to  determine 
pressure  gradient  across  a  vascular  bed  and  determine  how  ischemic  injury  impacts  this  driving  force 
of  blood  flow. 
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In  addition  to  experimental  procedures  involving  laboratory  mice,  our  research  program  is  also 
attempting  to  further  our  understanding  of  ischemia  and  limb  injury  on  vascular  physiology  and  limb 
function  through  numerical  modeling  strategics.  A  second  use  of  the  micropressure  system  described 
above  will  be  allow  us  to  measure  the  arterial  pressure  within  skeletal  muscle  to  provide  the 
boundary  conditions  for  our  model  calculations  as  well  as  validate  the  pressure  predictions  made  by 
our  model. 

The  second  major  piece  of  equipment  that  1  was  able  to  purchase  through  this  award  is  a  biosensor 
system  (Figures  6  &  1).  The  purpose  of  the  biosensor  system  is  to  measure  the  concentrations  of 
biological  molecules  that  readily  participate  in  oxidation-reduction  reactions.  The  Biosensor  is 
composed  of  two  main  components-  an  ampcromctric  electrode  and  an  amplifier/signal  processor.  A 
specific  Poise  voltage  (that  is  the  voltage  that  induces  maximum  reduction  of  a  particular 
biomolccule)  is  continuously  applied  to  the  solid  microclectrode  from  the  main  unit.  However,  the 
electrode  is  part  of  an  incomplete  circuit  and  therefore  current  will  not  effectively  flow  through  the 
electrode  unless  that  biomolecules  is  present.  When  the  biomolecules  (that  is  effectively  reduced  at 
the  specific  Poise  voltage  applied  to  the  electrode)  is  present,  an  oxidation-reduction  reaction  occurs 
that  completes  the  electrode  current  and  allows  current  to  flow.  Therefore,  the  resistance  to  current 
flow  in  the  electrode  is  directly  proportional  to  the  amount  of  biomolecule  in  the  solution.  The 
specific  biomoleculcs  that  can  be  assessed  with  this  device  include  oxygen,  nitric  oxide,  hydrogen 
peroxide,  hydrogen  sulfide,  and  glucose-  the  first  three  of  which  are  critical  factors  involved  in 
controlling  vasodilation  and  functional  hyperemia. 


Figure  6.  Biosensor  system  main  unit 
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Figure  7.  Biosensor  system 

Although  we  were  unable  to  use  the  biosensor  for  in  vivo  measurements,  we  were  able  to  perform 
beneh-top  ealibrations  of  the  nitrie  oxide  eleetrode  (figure  8). 

The  ability  of  arterial  vessel  to  dilate  and  inerease  downstream  blood  flow  depends  on  the  proper 
signals  being  sent  to  the  smooth  musele  eells  to  instruet  these  eells  to  eontraet  and  deerease  blood 
flow  (vasoeonstrietion)  or  relax  and  inerease  blood  flow  (vasodilation).  As  mentioned  in  the 
introduetion,  there  is  not  one  single  signaling  moleeule  responsible  for  making  smooth  musele  eells 
relax.  Fortunately,  with  our  biosensor  system  we  will  be  able  to  measure  the  eoneentrations  of  three 
molecules  produced  by  the  endothelium  that  signal  the  smooth  muscle  cells  to  relax-  nitric  oxide, 
hydrogen  peroxide,  hydrogen  sulfide.  Measuring  how  ischemic  injury-repair  affect  the  production  of 
the  signaling  molecules  will  bring  us  much  closer  to  determining  the  molecular  cause  of  impaired 
hyperemia  following  ischemic  injury.  Furthermore,  the  ultimate  regulator  of  both 
vasodilation/vasoconstriction  and  microvascular  growth  is  oxygen. 
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Figure  8.  Nitric  oxide  bench-top  calibration  with  biosensor  system 

As  oxygen  concentrations  can  be  measured  with  our  biosensor,  we  will  be  able  to  describe  the  effects 
of  ischemic  on  this  critical  regulatory  molecule-  better  understanding  what  features  of  ischemia 
(hypoxia,  inflammation,  tissue  growth)  are  most  critical  in  affecting  tissue  function. 

In  conclusion,  the  primary  interest  of  my  research  program  is  in  understanding  how  injury-repair  and 
disease  affect  tissue  function.  Specifically,  we  are  interested  in  microvascular  function  because  the 
efficient  exchange  of  nutrients  and  wastes  is  critical  to  tissue  function.  Unfortunately  (given  its 
critical  importance),  microvascular  function  is  impaired  following  injury  and  disease.  Therefore,  the 
ultimate  aim  of  our  laboratory  is  to  describe  the  molecular  mechanism  for  the  impainnent  of  vascular 
function  by  ischemic  injury.  This  proposal  allowed  use  to  make  significant  movement  towards  the 
completion  of  this  goal  through  the  purchase  of  equipment  that  will  allow  us  to  assess  both 
hemodynamics,  cellular  signaling,  and  tissue  health  (oxygenation)  in  healthy  animals  and  following 
ischemic  injury. 
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Single-Cell  Impedance  Sensing  for  Pathogen  Detection  and  Disease  Quantification 
Purpose 

The  motivation  behind  this  work  was  to  provide  early  detection  of  pathogen  or  toxin- 
related  abnormalities  at  the  cellular  level  with  the  particular  goal  to  make  this  technology 
available  to  front-line  war-fighters,  with  a  secondary  application  to  clinical  diagnostics 
for  example,  cancer  screening.  Why  single  cell  detection?  Most  diagnostics  indicators  are 
based  on  macroscopic  symptoms,  e.g.,  fever,  swelling,  wheezing,  and  sneezing.  For 
such  symptoms  to  surface,  typically  thousands  of  cells  are  infected;  hence,  a  person 
exhibiting  such  symptoms  could  be  in  serious  or  terminal  condition  and  may  need  to  be 
quarantined.  If,  however,  there  were  a  deployable  system  that  could  be  used  to  perform 
routine  checks  on  personnel  via  throat  swab  or  blood  sample,  the  war-fighter’s  health 
could  be  assessed  at  treatable  stages. 

The  operational  concept  is  a  system  that  can  be  deployed  in  a  first-aid  vehicle  and 
personnel  would  be  spot-checked  to  enable  early  detection.  The  desired  assay  should 
have  the  following  features: 

i)  Minimally  invasive  sample  collection 

ii)  Ease  of  use 

iii)  Capability  to  detect  single  cells  or  small  groups  of  cells 

iv)  Rapid  detection 

v)  Portability 

Under  these  concepts  of  operation,  a  MEMS-based  single  cell  impedance  sensor  was 
proposed,  together  with  low  cost,  easy  to  use  support  equipment. 

During  the  duration  of  the  C^RP  grant,  we  developed  a  Bio-MEMS  device  to  capture 
single  cells  and  groups  of  cells.  The  resultant  concept  design  is  shown  below  in  Figure  1. 
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Figure  1.  On  the  left  is  a  multi-chamber,  single-cell  design  to  enable  simultaneous 
statistical  analysis.  On  the  right  is  a  single  chamber  to  demonstrate  the  concept. 


As  shown  above,  the  multiple-  chamber  design  on  the  left  is  optimal  to  enable  rapid 
prediction  of  average  Impedance  Spectra.  In  this  design,  cells  are  introduced  into  multiple 
chambers  that  “dead-end”  in  a  detection  chamber.  The  detection  chambers  are  in  suction 
mode  during  loading.  This  design  ensures  (100%)  that  cells  will  be  captured  in  each 
chamber.  To  demonstrate  the  concept  of  a  “dead-end”  or  sure-fire  capture  chamber,  a 
single  capture  chamber  was  manufactured  that  is  representative  of  the  chambers  on  the 
multi-chamber  system.  (It  is  important  to  note  that  the  multi-chamber  design  was  also 
manufactured  and  tested.  It  did  have  some  re-design  issues  that  were  beyond  the  scope 
and  timing  of  the  MS  student  working  on  the  project.)  The  resultant  single-chamber 
design  was  instantiated  in  PDMS  and  is  shown  in  Figure  2. 


Electrodes 

Figure  2.  A  collection  of  cells  in  the  PDMS  (PolyDimethylSiloxane,  translucent  rubber) 
capture  chamber  with  Au  electrodes. 

As  shown  above,  a  collection  of  cells  are  positioned  between  the  electrodes.  The 
geometric  features  of  the  channel  walls  and  chamber  walls  appear  as  white  lines.  The 


80 


N00014-07-1-1152 


P.I. Susan  C.  Opava,  Ph.D. 


central  channel  leading  vertically  below  the  cells  is  a  suction  channel  to  help  position  and 
hold  the  cells  in  the  chamber  where  the  electrodes  meet.  The  two  channels  that  are  at  45 
degrees  and  meet  near  the  top  electrode  pair  are  included  to  enable  backflush  or  expel 
extra  cells  in  the  capture  chamber.  The  speckled  white  dots  in  the  PDMS  regions  are 
merely  optical  artifacts  and  do  not  represent  anything  significant. 

The  cell  capture  chamber  was  designed  for  10  micron  diameter  cells;  hence,  if  the  cell 
diameter  is  smaller  than  10  microns  there  will  be  an  accumulation  of  cells  in  the  capture 
chamber.  If  however  the  cell  size  is  on  the  order  of  10  microns,  only  a  single  cell  can  be 
captured,  see  figure  3  below. 


Feed  bead 
suspension 


Single  10  pm  bead 
in  capture 
chamber 


Figure  3.  Capture  of  a  10  micron  polystyrene  bead  in  a  single-cell  capture  chamber 

A  bead  suspension  is  introduced  into  the  chamber  and  via  suction,  a  single  bead  is 
positioned  into  the  capture  chamber.  To  ensure  that  only  a  single  bead  is  in  the  chamber, 
a  back  flow  is  introduced  in  the  45  degree  channels,  as  described  above,  with  continued 
suction  in  the  primary  capture  channel,  and  the  excess  beads  are  flushed  out  back  into  the 
feed  suspension  chamber  (also  see  Figure  2). 

Additionally,  as  shown  in  Figure  2.,  the  capture  chamber  is  equipped  with  parallel 
electrodes.  Once  positioned  in  the  chamber,  the  cell  or  cells  are  subject  to  an  AC  signal  at 
progressively  larger  field  frequencies.  These  same  electrodes  simultaneously  create  the 
AC  field  and  read  the  input  current  at  the  various  frequencies  and  the  resultant  impedance 
is  back-calculated. 

To  drive  the  electrodes  and  to  analyze  the  impedance  response,  a  system  was  set  up  using 
National  Instruments  cards  for  the  electronics,  coupled  with  a  Labview^^  interface.  In 
Figure  4,  the  fluidic  and  the  electronic  interface  are  shown. 
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Figure  4.  The  experimental  setup  with  Labview™  and  mierofludic  interface. 


As  described  above,  the  device  enabled  capture  and  isolation  of  a  single  cell  based  solely 
on  fluid  flow  control.  In  parallel  with  this  effort,  the  electronic  circuit  was  designed  and 
implemented  to  enable  swept-frequency  AC-signal  and  Impedance  sensing.  The  circuit 
design  was  implemented  using  a  National  Instruments  Signal  Generator  and  data 
acquisition  cards.  The  packaged  device  was  designed  to  enable  fluid  and  electrical 
connection.  The  connection  was  designed  to  enable  connection  from  the  macroscopic 
world  to  the  microscopic.  This  assembly  was  then  integrated  with  a  LabSmith™  inverted 
microscope  utilizing  the  Dell  XPS  with  the  National  Instruments  cards  and  Labview™ 
interface.  The  XPS  served  as  a  work-station  to  both  drive  the  circuit  and  to  collect  video 
data  of  the  cell  capture  process.  The  electrical  and  fluidie  connections  arc  shown  in 
packaged  assembly  below  in  figure  5. 
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Figure  5.  The  packaged  cell  capture  chip.  On  the  right  the  electrical  connections  are 
shown.  In  the  center  is  the  chip  illuminated  by  the  inverted  microscope  light  source. 

The  support  structure  for  the  assembly  shown  above  is  a  plexiglass  breadboard  that 
enables  mounting  of  Labsmith™  microfluidic  valves  and  plumbing.  The  outline  of  the 
chip  can  be  seen  in  the  middle,  and  below  is  the  LED  microscope  light  source. 

Another  significant  contribution  to  this  capability  is  the  software  interface  to  enable 
simultaneous  signal  generation  and  data  acquisition.  The  interface  between  the  National 
Instruments  function  generator  and  data  acquisition  cards  was  accomplished  through  a 
Labview™  program  developed  by  MS  student,  Stephanie  Hernandez.  The  Labview™ 
program  enabled  use-defined  signal  production/control,  data  acquisition  and  analysis. 
Additionally,  a  Labview™  interface  was  developed  to  enable  an  effective  human 
interface  for  experimentation.  The  interface  is  shown  below  in  Figure  6. 
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Figure  6.  Labview^'^  interface.  The  graphs  display  the  measured  signal  (above/left)  and 
phase  (below/left).  On  the  right,  the  user  can  input  the  signal  source,  the  measurement 
source,  the  signal  amplitude  and  the  signal  frequency. 

Using  the  system  and  interface  described  above,  impedance  spectra  were  developed  for 
air,  saline  solution,  a  10  pm  polystyrene  bead  in  saline  and  a  collection  of  yeast  cells  with 
diameters  less  than  10  pm  in  saline.  The  results  are  compared  in  Figure  7. 


84 


N00014-07-1-1152 


P. I. Susan  C.  Opava,  Ph.D. 


4 

3  E-D7 

3  El^^Dr 

I  :t<* *7 

o 

ft 
w 

1  • 

E 

1  L*-D7 

1  03E-K)3  1  03E<I4  1  XE-KK  1  ODE +06  t 

Ptt^utiiqr  

Figure  7.  Impedance  spectra  for  air  (dark  blue),  saline  solution  (magenta),  polystyrene 
bead  (green)  and  yeast  cells  (turquoise).  The  frequency  ranged  from  10  Hz  to  40  MHz. 

The  spectra  above  cover  the  desired  range  necessary  for  cellular  characterization,  100  Hz 
to  30MHz.  Through  these  measurements,  a  critical  piece  of  information,  the  crossover 
frequency,  can  be  characterized  for  various  cell  types,  healthy  cells  and  diseased  cells. 
More  specifically,  the  crossover  frequency  is  the  frequency  at  which  the  target  spectrum 
is  equal  to  the  pure  saline  or  background  frequency.  As  shown  above,  the  crossover 
frequency  for  a  collection  of  yeast  cells,  in  our  system,  is  approximately  5MHz. 

Major  Accomplishments 

This  work  has  resulted  in  the  following  major  accomplishments: 

•  MS  degree  Josh  Fradriquela  (Microfluidic  single  Cell  Capture  Device)  in  progress 

•  MS  degree  Stephanie  Hernandez  (LabviewTM  interface  and  Impedance 
Experiments)  in  progress 

•  Design  and  development  of  a  microfluidic  single-cell  capture  device. 

•  Design  and  development  of  a  system  to  conduct  impedance  spectra  experiments 

•  Poster  presentation  at  the  “2009  Lab  on  a  Chip  World  Congress” 


Impvdanc*  Comparison 
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Future  Plans 

A  start-up  company  in  Minnesota  has  expressed  interest  in  working  with  us  and  possibly 
hiring  students  associated  with  this  project.  Additionally  this  system  will  be  adapted  for 
stem-cell  research.  Specifically  the  system  can  be  used  to  characterize  cellular 
modification  via  chemical  stimulation,  c.g.,  differentiation,  up-rcgulation  of  proteins,  cell 
death,  etc. 

Current  activities 

MS  student  Stephanie  Hernandez  is  still  taking  data  on  yeast  cells  using  the  system.  In 
particular,  she  is  examining  “dead”  yeast  cells  to  compare  with  live  yeast  cells  to 
demonstrate  a  demonstrative  change  in  spectra  using  the  same  cell  line.  Additionally  MS 
student  Tom  Harper  will  carry  on  Stephanie’s  work  and  adapt  the  system  to  explore 
spectra  for  cell  differentiation.  A  new  graduate  student  will  be  recruited  to  work  along 
side  Tom  Harper. 

The  resulting  work  has  been  proposed  to  DARPA  as  an  approach  to  detection  of  sub¬ 
micron  particles,  e.g.,  virus  collection  and  detection  from  saliva  samples.  In  the  proposed 
scheme,  polystyrene  beads  will  be  functionalized  to  create  a  surface  layer  of  small 
species,  c.g.,  proteins,  viruses,  etc.  The  functionalized  beads  will  be  characterized  prior 
to  exposing  the  beads  to  a  sample  solution  containing  the  target  macromolecule.  Once  the 
bead  has  captured  the  target,  it  will  be  interrogated  via  the  Impedance  Sensor  System  and 
the  spectra  will  be  compared  to  bead  without  target.  The  resulting  net  spectrum  will  be 
used  to  1)  detect  the  presence  of  the  target  in  the  sample,  and  2)  to  develop  conductivity 
and  permittivity  data  to  characterize  these  properties  of  the  target,  that  is,  properties  yet  to 
be  definitively  measured. 
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Multi-AUV  Path  Optimization  for  improved  Ocean  Model  Forecasting 


Primary  Investigators:  Christopher  M.  Clark,  Mark  A  Moline 


Introduction 

Oceans  provide  us  with  some  of  our  most  valuable  resources.  To  manage  and  conserve  them  requires  us 
to  understand  them.  This  can  be  difficult  because  their  characteristic  parameters  (e.g.  temperature, 
currents,  etc.)  have  large  spatial  and  temporal  variability. 

Ocean  modeling  provides  an  essential  tool  in  predicting  such  characteristic  parameters  with  a  limited  set 
of  measurements.  Moreover,  models  can  be  used  to  forecast  future  values  of  the  parameters. 
Unfortunately,  the  limited  availability  of  sensor  measurements  for  building  such  models  may  not  be 
adequate  for  generating  accurate  forecasts. 

To  remedy  this  problem,  a  system  of  multiple  Autonomous  Underwater  Vehicles  (AUVs)  ean  be 
deployed  between  forecasts  to  obtain  measurements  in  the  specific  locations  which  will  lead  to  the 
greatest  improvement  in  accuracy  of  the  ocean  model  forecast. 

The  core  of  this  project  was  to  develop  an  algorithm  that  constructs  AUV  trajectories  that  are  optimal  in 
the  sense  that  their  measurements  will  minimize  errors  in  tracking  points  subject  to  the  practical 
constraints  associated  with  a  real  AUV  (e.g.  maximum  velocity,  turning  radius,  ocean  currents  etc.)  In  this 
context,  the  points  to  be  tracked  by  the  AUV  are  those  that  minimize  error  in  ocean  parameter  forecasting. 

Along  these  lines,  the  investigators  have  developed  a  new  algorithm  to  plan  paths  for  multiple  AUVs  that 
must  visit  designated  locations  of  interest.  Unlike  previous  work,  this  algorithm  takes  into  consideration 
1)  kinematic  constraints  of  the  AUV,  2)  dynamic  model  of  the  AUV  when  calculating  path  costs,  and  3) 
the  presence  of  ocean  currents. 

Algorithm  Development 

This  research  addresses  the  problem  of  allocating  targets  to  multiple  autonomous  underwater  vehicles 
(AUV)  in  the  presence  of  constant  ocean  currents.  The  main  difficulty  of  this  problem  is  that  the  non- 
holonomic  vehicles  are  constrained  to  move  along  forward  paths  with  bounded  curvatures.  The  Dubins 
model  is  a  simple  but  effective  way  to  handle  the  kinematic  characteristics  of  AUVs.  It  gives  complete 
characterization  of  the  optimal  paths  between  two  configurations  for  a  vehicle  with  limited  turning  radius 
moving  in  a  plane  at  constant  speed. 

In  the  algorithm  developed,  Dubins  paths  arc  modified  to  include  ocean  currents,  resulting  in  paths 
defined  by  curves  whose  radius  of  curvature  is  not  constant.  To  determine  the  time  required  to  follow 
such  paths,  an  approximate  dynamic  model  of  the  AUV  is  queried  due  to  the  computational  complexity  of 
the  full  model.  The  lower  order  model  is  built  from  data  obtained  from  sampling  the  full  model.  The  full 
model  is  used  in  evaluating  the  final  tour  times  of  the  sequences  generated  by  the  proposed  algorithm  to 
validate  the  results. 
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Results 

The  proposed  algorithm  solves  the  task  allocation  problem  with  market-based  auctions  that  minimize  the 
total  travel  time  to  complete  the  mission.  The  novelty  of  the  research  is  the  path  cost  calculation  that 
combines  a  Dubins  model,  an  AUV  dynamic  model,  and  a  model  of  the  ocean  current.  Simulations  were 
conducted  in  Matlab  to  illustrate  the  performance  of  the  proposed  algorithm  using  various  numbers  of 
task  points  and  AUVs.  The  task  points  were  generated  randomly  and  uniformly  close  together  to  highlight 
the  necessity  for  considering  the  curvature  constraints.  Sample  task  point  sequences  and  the  resulting 
paths  are  shown  in  Figure  1 . 


Figure  1:  Task  point  sequences  generated  by  an  alternating  algorithm  that  minimizes  Euclidean  distance 
path  costs  (a  and  c),  as  well  as  by  the  proposed  algorithm  that  considers  kinematics  when  planning  (b  and 
d).  Additionally  currents  of  velocity  0.25  m/s  in  the  positive  x  direction  were  added  in  (b  and  d). 

For  a  sufficiently  dense  set  of  points,  it  becomes  clear  that  the  ordering  of  the  Euclidean  tours  (created 
with  an  Alternating  algorithm)  are  not  optimal  in  the  case  of  the  Dubins  multiple  travelling  salesmen 
problem.  This  is  due  to  the  fact  that  there  is  little  relationship  between  the  Euclidean  and  Dubins  metrics, 
especially  when  the  Euclidean  distances  are  small  with  respect  to  the  turning  radius.  An  algorithm  for  the 
Euclidean  problem  will  tend  to  schedule  very  close  points  in  a  successive  order,  which  can  imply  long 
maneuvers  for  the  AUV.  This  is  clearly  demonstrated  by  the  numerous  loops  that  become  problematic 
with  dense  sets  of  points.  The  algorithm  proposed  in  this  research  does  not  rely  on  the  Euclidean  solution 
and  therefore,  even  in  the  presence  of  ocean  currents,  can  create  paths  that  are  feasible  for  curvature 
bounded  vehicles.  To  note,  path  times  were  decreased  considerably  in  the  simulations  when  using  the 
proposed  algorithm  as  compared  to  the  Alternating  algorithm  (see  Table  1). 
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Table  I :  Comparison  of  path  completion  times  for  the  alternating  algorithm  and  the  proposed  algorithm. 
Field  tests  were  also  conducted  on  an  Iver2  AUV  at  the  Avila  Pier  in  California  to  validate  the 
performance  of  the  proposed  algorithm  in  real  world  environments,  (see  Fig  2).  Missions  created  based  on 
the  sequences  generated  by  the  proposed  algorithm  were  conducted  to  observe  the  ability  of  an  AUV  to 
follow  paths  of  bounded  curvature  in  the  presence  of  ocean  currents. 


(a)  (b) 


Figure  2:  The  Center  for  Coastal  Marine  Science  located  at  Avila  Pier  (a)  and  the  Iver2  AUV  (b). 

Results  show  that  the  proposed  algorithm  generated  paths  that  were  feasible  for  an  AUV  to  traek  elosely, 
even  in  the  presence  of  ocean  current.  In  Figure  3,  a  sample  set  of  thee  AUV  paths  are  shown  that  were 
planned  for  by  the  proposed  algorithm  and  tracked  by  the  Iver2  AUV. 
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Figure  3:  Example  paths  planned  to  be  track  20  points  by  3  AUVs  (a).  Actual  paths  (solid  line)  tracked  by 
the  Iver2  AUV  in  Avila  Bay  are  shown  in  (a),  (b),  and  (c). 

Outcomes 

Currently,  the  work  is  being  published  in  several  forms.  Student  Beverly  Chow’s  Master’s  Thesis  [1]  has 
been  published  which  details  both  the  algorithm  development  and  ocean  results.  The  experimental  results 
[2]  will  be  published  and  presented  at  the  International  Symposium  on  Unmanned  Untethered 
Submersible  Technology  (UUST).  Algorithm  details  and  simulation  results  were  submitted  in  the 
form  of  a  conference  paper  [3]  to  the  lEEE/RSJ  International  Conference  on  Intelligent  RObotics 
Systems  (IROS).  Finally,  a  journal  paper  is  under  preparation  [4]. 

As  a  broader  outcome,  the  algorithm  developed  will  be  used  for  planning  within  an  ocean  modeling 
system  that  is  scheduled  to  be  up  and  running  in  by  fall.  The  model  will  cover  the  Avila  Bay  area, 
enabling  forecasting  of  ocean  parameters  including  temperature  and  currents  in  3  dimensions. 
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Relevance  to  ONR 

This  work  falls  directly  in  line  with  ONR’s  Code  311-  Autonomous  Systems,  in  which  “Research  is 
conducted  in  motion  planning  algorithms  and  behavior  of  teams  of  agents". 
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Report  Section  1:  100  kHz  Axial  Scan  Rate  Swept-Wavelength  OCT  using 
Sampled  Grating  Distributed  Bragg  Reflector  Lasers 


Shane  O’Connor,  Michael  A.  Bemacil,  Andrew  DeKelaita,  Ben  Maher,  and  Dennis  Derickson 
California  Polytechnic  State  University,  1  Grand  Avenue,  San  Luis  Obispo,  CA  93407 
Contact  person:  Dennis  Derickson,  ddericks@calpoly.edu,  805-756-7584 


ABSTRACT 

Fast  wavelength  tunable  sampled  grating  distributed  Bragg  refleetor  (SG-DBR)  lasers  are  used  to  generate  fast, 
linear,  eontinuous  wavelength  sweeps.  High  resolution  wavelength  sweeps  in  exeess  of  45  nm  are  demonstrated  at  a 
100  kHz  repetition  rate.  The  front  mirror,  baek  mirror  and  phase  segment  tuning  segments  ean  be  modulated  at  very  fast 
rates,  whieh  allows  for  very  fast  wavelength  ramp  rates.  This  sweep  is  generated  through  three  time  synehronized 
current  versus  time  waveforms  applied  to  the  back  mirror,  front  mirror  and  phase  sections  of  the  laser.  The  sweep 
consists  of  fifty  separate  mode-hop-free  tuning  segments  which  are  stitched  together  to  form  a  near  continuous 
wavelength  ramp.  The  stitching  points  require  a  maximum  of  60  ns  for  amplitude,  wavelength,  and  thermal  settling  time 
to  allow  the  laser  to  equilibrate.  Wavelength  tuning  non-linearities,  output  power  wavelength  dependency,  and 
wavelength  discontinuities  are  defects  in  the  wavelength  sweep  that  result  from  properties  of  the  wavelength  tuning 
meehanism  as  well  as  limitations  of  the  signal  generators  that  produee  the  time  varying  bias  currents.  A  Michelson 
Interferometer  is  used  to  examine  the  effeets  of  these  defects  for  optical  coherence  tomography  (OCT).  The  OCT 
measurements  demonstrate  spectral  broadening  of  the  souree  and  interference  signal  reduction  as  the  penetration  depth 
increases.  However,  these  effects  are  not  very  severe  for  delay  differences  less  than  2  mm  even  without  eorreetion  for 
sweep  nonlinearities. 

Keywords:  optieal  eoherenee  tomography,  tunable  semiconductor  lasers,  distributed  Bragg  refleetor  lasers 

INTRODUCTION 

Sampled  grating  distributed  Bragg  reflector  (SG-DBR)  lasers  demonstrate  wavelength  switehing  times  that  are  faster 
than  any  other  laser  in  its  class.  Because  monolithic  cavity  SG-DBR  lasers  utilize  a  much  smaller  cavity  length  than 
fiber-optie  ring  lasers*  and  external  cavity  lasers^,  SG-DBR  lasers  are  capable  of  generating  wavelength  sweeps  at  much 
faster  sweep  rates.  Experimental  results  demonstrate  that  SG-DBR  lasers  are  capable  of  stepped-wavelength  switching 
times  on  the  order  of  1 0  ns  for  the  phase  section  of  the  laser^.  Furthermore,  the  large  and  continuous  tuning  range  of  the 
SG-DBR  laser  in  the  C-band,  whieh  exeeeds  45  nm^,  is  another  useful  feature  of  these  devices.  SG-DBR  lasers  with 
adjaeent  wavelength  band  coverage  can  be  concatenated  for  even  larger  wavelength  eoverage.  However,  creating  a 
eontinuous  wavelength  sweep  requires  implementing  a  complicated  tuning  meehanism  as  deseribed  in  [4]. 

To  implement  this  tuning  meehanism,  three  synehronized  arbitrary  waveform  generators  are  used.  The  arbitrary 
waveforms  are  generated  through  a  mapping  of  the  wavelength  as  a  function  of  current  into  the  front  mirror,  baek  mirror 
and  phase  sections  of  the  laser.  From  this  wavelength  map,  a  set  of  currents  versus  time  are  synthesized  for  eaeh  of  the 
wavelength  tuning  segments.  The  result  provides  for  a  continuous  wavelength  sweep  from  1523.317  nm  to 
1 570.078  nm.  Repetition  rates  as  fast  as  100  kHz  for  the  47  nm  wavelength  sweep  are  demonstrated.  However, 
wavelength  stitehing  discontinuities  in  the  wavelength  sweep  become  apparent  at  high  repetition  rates.  Experimental 
analysis  show  that  the  sweep  rate  and  performance  limitations  are  due  to  bandwidth  limitations  of  the  arbitrary 
waveform  generators. 

A  Michelson  interferometer  is  used  to  experimentally  test  this  high  bandwidth,  high  speed  wavelength  sweep  for 
high  resolution  OCT  applications.  The  results  demonstrate  that  the  spectral  content  of  the  measurements  begin  to 
degrade  after  approximately  2  millimeters  of  delay  difference  for  the  47  nm  wavelength  sweep  operating  at  a  sweep  rate 
of  1 00  kHz.  In  this  OCT  experiment,  no  attempt  was  made  to  compensate  for  sweep  non-linearities. 
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2.1.  Constructing  the  Wavelength  Sweep 


Figure  1  illustrates  the  bloek  diagram  used  to  generate  a  fast  wavelength  sweep.  Three  arbitrary  waveform 
generators,  synehronized  by  a  trigger  input,  are  required  to  drive  the  three  wavelength  tuning  segments  of  the  laser.  The 
gain  and  SOA  seetion  of  the  laser  are  D.C.  biased.  Eaeh  voltage  input  is  eonverted  to  a  eurrent  input  through  the  use  of  a 
series  eurrent  limiting  resistor.  The  temperature  of  the  laser  is  held  eonstant  at  22”  C  using  a  Thermoeleetric  Cooler 
(TEC)  eontroller.  The  optieal  isolator  at  the  output  prevents  refleettons  from  eausing  undesired  instability  and  linewqdth 
broadening  within  the  laser.  Though  the  laser  eontains  an  internal  isolator,  experimental  tests  proved  this  isolation  to  be 
inadequate. 


Figure  1:  (a)  The  block  diagram  required  for  a  fast  wavelength  sweep  generation  is  shown.  Three  arbitrary  waveform  generators  are 
used  to  drive  the  three  wavelength  eontrol  eonnections  to  the  laser  (Front  Mirror,  Baek  Mirror,  and  Phase  Seetions).  The  resulting 
ramp  of  the  laser  wavelength  over  a  1523  nm  to  1570  nm  wavelength  range  is  aeeomplished  in  less  than  10  mieroseeonds.  (b)  This  is 
a  pieture  of  the  SGDBR  laser  paekage  and  the  high  speed  eoaxial  drive  eonneetions. 


In  order  to  create  a  linear,  continuous,  wavelength  sweep,  the  time  varying  bias  currents  to  the  front  mirror,  back 
mirror,  and  phase  sections  must  be  configured  appropriately.  The  DC  tuning  map  of  the  laser  was  generated  by  varying 
the  current  into  the  front  mirror  and  back  mirror  for  the  set  up  in  Figure  1 .  An  example  tuning  map  is  shown  in  Figure  2. 


Figure  2:  Mode  map  demonstrating  wavelength  as  a  funetion  of  front  mirror  and  baek  mirror  bias  currents.  From  this  mode  map,  a 
tuning  strategy  is  obtained  to  generate  a  eontinuous  and  linear  wavelength  sweep  from  1523.317  nm  to  1570.078  nm.  The  eurrents 
are  ehosen  to  follow  the  paths  1  through  10  that  are  illustrated  in  the  diagram  in  order  to  eover  the  full  laser  wavelength  range. 
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In  order  to  tunc  the  laser  from  the  shortest  to  longest  available  wavelengths,  a  series  of  paths  needs  to  be  followed  on  the 
tuning  curve  shown  in  figure  2.  By  sequencing  through  a  series  of  paths  from  1  to  10,  the  entire  wavelength  range  of  the 
SGDBR  lasers  can  be  covered.  In  addition  to  the  basic  tuning  map  of  Figure  2,  additional  tuning  information  for  the 
phase  current  and  the  exact  route  to  take  on  each  tuning  path  is  required.  Figure  3  shows  an  illustration  of  one  of  the 
paths  and  the  optimum  route  to  take  on  this  path. 
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Figure  3:  The  middle  plot  illustrates  path  6  found  in  figure  2  in  more  detail,  (a)  The  upper  path  boundary  is  eharaeterized  by  a  +5  nm 
inerease  in  wavelength,  (b)  The  lower  path  boundary  is  eharaeterized  by  a  -5  nm  decrease  in  wavelength,  (c)  For  a  small  value  of 
phase  eurrent,  a  loeus  of  points  is  shown  where  the  +-  0.3  nm  offset  peaks  are  at  a  symmetrieal  level,  (d)  For  a  medium  value  of  phase 
current  a  locus  of  points  is  shown  where  the  +-  0.3  nm  offset  peaks  are  at  a  symmetrical  level  (e)  For  a  large  value  of  phase  eurrent  a 
locus  of  points  is  shown  where  the  +-  0.3  nm  offset  peaks  are  at  a  symmetrical  level,  (f)-  The  best  spectral  shape  bias  point  for  the 
medium  value  of  phase  current  is  shown.  Both  a  narrow  span  and  wide  span  spectral  trace  show  the  bias  point  with  best  speetral 
shape.  A  0.07  nm  resolution  bandwidth  was  used  for  all  of  the  speetral  measurements  shown  in  this  figure. 
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In  figure  3a/b  the  boundaries  of  an  example  tuning  path  with  speetral  examples  are  given.  Three  example  bias  points 
with  low  medium  and  high  phase  eurrents  are  shown  in  figure  3  e/d/e.  An  example  speetral  plot  for  a  best  bias  point  for 
the  front  mirror,  baek  mirror,  and  phase  seetions  is  shown  in  figure  3f  A  eomputer  algorithm  was  generated  to  sweep 
the  laser  through  eaeh  path  and  eome  up  with  the  best  set  of  diserete  bias  points  for  best  rejeetion  of  unwanted  speetral 
side  lobes.  A  computer  program  was  then  used  to  interpolate  between  eaeh  of  these  best  speetral  points  and  generate  a 
table  that  eould  be  used  by  the  arbitrary  waveform  generators  shown  in  figure  1.  Figure  4  shows  an  example  set  of  bias 
values  that  were  sent  to  the  arbitrary  waveform  generator. 


Arbitrary  Waveform  Generator  Tuning  Waveforms  for  a  47  nm 
Wavelength  Sweep 


Figure  4:  Example  drive  voltages  versus  time  for  the  back  mirror,  front  mirror,  and  phase  tuning  sections.  These  voltages  arc 
programmed  into  the  arbitrary  waveform  generators  of  figure  1 .  (a)  The  tuning  voltages  for  a  47  nm  wide  sweep  are  shown,  (b)  The 
tuning  voltages  for  a  narrow  sweep  arc  shown. 

The  waveforms  shown  in  figure  4  show  a  saw-tooth  shaped  set  of  drive  voltages.  The  front  mirror  and  baek  mirror 
eurrents  repeat  approximately  every  7nm  of  the  tuning  curve.  The  phase  current  repeats  approximately  every  1  nm.  The 
point  in  the  waveform  where  the  slope  is  near  vertical  is  called  a  wavelength  ramp  stitching  point.  At  the  stitching  point 
the  current  of  the  laser  is  changed  abruptly  but  the  wavelength  before  and  after  the  abrupt  laser  current  change  should  be 
identical.  During  the  wavelength  stitching  events,  the  laser  is  going  trough  a  mode  change  and  the  laser  output  is  not 
useful  during  that  time  interval.  Later  seetions  of  this  paper  show  that  the  time  duration  of  these  stitching  events  is  about 
50  ns  for  this  prototype  system.  The  sweep  that  is  constructed  from  this  laser  is  then  a  series  of  50  continuous  tuning 
segments  stitched  together  with  50  ns  transition  times  between  the  segments. 
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2.2.  Wavelength  Sweep  Analysis 

The  current  waveforms  of  Fig.  4  were  repeated  at  a  series  of  repetition  rates  between  0.1  Hz  of  1  MHz.  The  time- 
averaged  spectrum  for  a  100  kHz  repetition  rate  is  shown  in  Figure  5.  This  sweep  exhibits  an  optical  sweep  width  of 
approximately  47  nm.  The  output  power  of  the  source  did  vary  with  position  in  the  sweep.  The  power  of  the  source 
varies  along  each  path  shown  in  figure  2  if  the  gain  section  and  semiconductor  optical  amplifier  segments  are  at  a 
constant  bias  level.  Amplitude  flatness  can  be  obtained  by  providing  a  current  amplitude  control  to  the  semiconductor 
optical  amplifier  segment  as  the  laser  tunes  across  the  band. 


47  nm  Wavelength  Sweep  Spectrum 


Wivalength  (nm) 


Figure  5:  This  shows  the  time  averaged  power  versus  wavelength  for  the  laser  tuning  over  a  47  nm  wavelength  range  at  a  100  KHz 
repetition  rate.  A  0.1  nm  resolution  bandwidth  is  used  in  this  measurement. 

An  experiment  was  set  up  to  test  the  linearity  of  the  wavelength  sweep  and  the  time  duration  of  the  wavelength  stitching 
points.  Figure  6  shows  the  measurement  apparatus  for  characterizing  wavelength  versus  time. 


Figure  6:  A  repetitive  band  pass  filter  is  used  to  assess  the  linearity  of  the  wavelength  versus  time. 

A  Fabry-Perot  filter  with  a  0.4  nm  free  spectral  range  was  place  at  the  output  of  the  tunable  laser.  The  periodic 
transmission  versus  wavelength  of  the  Fabry-Perot  filter  provides  wavelength  markers  that  repeat  as  the  tunable  laser  is 
scanned  over  its  tuning  range.  The  band  pass  filter  provides  an  FM  to  AM  conversion  of  the  laser  output,  since  the 
amplitude  of  the  transmitted  signal  at  the  output  of  the  filter  varies  as  a  function  of  the  input  wavelength.  The 
wavelength  ramp  at  the  output  of  the  laser,  which  provides  a  linear  change  in  wavelength  as  a  function  of  time,  will  then 
follow  the  shape  of  the  band  pass  filter  over  the  width  of  the  wavelength  sweep.  This  optical  signal  is  converted  to  an 
electrical  signal  with  a  high  speed  photodetector  and  applied  to  an  oscilloscope. 
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Fig.  7  shows  the  time  resolved  output  of  the  measurement  apparatus  in  fig.  6  for  sweep  repetition  rates  betw  een  1  Hz  and 
1  MHz.  The  horizontal  axis  is  time  normalized  to  the  period  of  the  sweep.  For  a  1  MHz  repetition  rate,  the  time 
eoverage  would  be  0  to  1  mieroseeond.  The  sweep  eovers  a  3.2  nm  range. 


Normalized  Transmission  Output  of  an  Optical  Repetitive  Band  Pass 
Filter  due  to  a  3.2  nm  Wavelength  Sweep 
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Figure  7:  An  example  output  for  the  measurement  apparatus  of  figure  6  is  shown.  The  output  of  the  repetitive  band  pass  filter 
demonstrates  the  performanee  of  the  wavelength  sweep  as  a  funetion  of  sweep  repetition  rate  from  I  Hz  to  I  MHz.  Two  types  of 
switehing  points  are  illustrated  for  the  laser.  Figure  7a  and  7e  show  stitehing  points  where  the  phase  eurrent  is  rapidly  switehed 
between  two  values.  Figure  7b  shows  a  triple  stitehing  point  where  front  mirror,  baek  mirror  and  phase  seetion  drives  are  abruptly 
ehanged.  The  ideal  measurement  result  would  show  a  smooth  ehange  in  filter  output  as  a  funetion  of  time  that  replieates  the 
transmission  versus  wavelength  funetion  of  the  Fabry-Perot  filter.  For  low  sweep  rates,  the  wavelength  diseontinuities  at  both  phase 
and  triple  stitehing  points  are  very  small.  For  high  sweep  rates  at  500  kHz  and  above  the  laser  does  not  stabilize  at  the  stitehing  points 
and  large  stitehing  errors  oeeur. 


The  drive  voltage  for  the  front  mirror,  baek  mirror  and  phase  seetions  is  shown  on  the  same  axis  as  the  output  of  the 
deteetor.  This  v/avelength  ramp  measurement  shows  two  types  of  wavelength  stitehing  errors.  The  first  phase  stiteh  in 
figure  7a  is  found  at  0.3  normalized  seeonds.  For  low  sweep  rates,  the  output  of  the  filter  is  smooth  indieating  a  small 
stitehing  error.  I^or  frequencies  above  500  kHz,  there  is  not  suffieient  time  for  the  laser  to  stabilize  and  a  wavelength 
eoverage  error  oeeurs.  The  stitehing  errors  are  more  pronouneed  when  a  triple  stitehing  point  oeeurs.  A  triple  stitehing 
point  oeeurs  when  the  phase,  front  mirror,  and  baek  mirror  drive  voltages  all  ehange  abruptly. 

The  time  duration  of  the  stiteh  transient  was  studied  in  detail.  The  SGDBR  laser  system  takes  approximately  40 
ns  to  equilibrate  to  the  identieal  wavelength  with  a  different  laser  longitudinal  mode  during  a  phase  stitehing  transition. 
The  stitching  point  at  0.5  normalized  seeonds  represents  the  worst  ease  triple  stiteh  situation  where  the  phase  seetion, 
front  mirror,  and  baek  mirror  eurrents  are  ehanged  simultaneously.  In  this  ease,  the  wavelength,  power  transient,  and 
thermal  transient  are  more  severe  but  the  entire  stitehing  time  is  still  less  than  60  ns. 
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2.3.  Experiment:  Michelson  Interferometer  OCT  measurements 

A  Michelson  Interferometer  is  used  to  test  the  fast  generated  wavelength  sweep  in  an  OCT  test  environment.  This 
optical  signal  is  split  into  two  paths;  a  reference  path  and  a  path  to  image  a  device  under  test.  The  reference  path 
contains  a  moveable  reflector  that  enables  the  ability  to  change  the  path  length  difference  between  the  reference  path  and 
the  path  to  the  OUT.  The  cleaved  end  of  a  single  mode  fiber  optie  cable  provides  4%  power  reflection  at  the  glass  to  air 
interface  and  serves  as  the  device  under  test.  The  two  optical  signals  are  mixed  at  the  output  of  the  interferometer, 
providing  an  optical  beat  signal  that  is  incident  on  a  photodeteetor.  The  photodeteetor  converts  the  envelope  of  the  beat 
signal  into  an  electrical  signal  that  ean  be  measured  by  a  spectrum  analyzer.  This  experimental  set  up,  illustrated  in 
Figure  8,  creates  a  simulated  OCT  experiment  in  which  the  change  in  the  delay  difference  between  the  reference  and  the 
DUT  allows  for  the  simulation  of  different  penetration  depths  within  the  DUT. 


Figure  8:  Block  diagram  of  the  Michelson  Interferometer  experiment  simulating  an  OCT  measurement. 

For  a  swept  wavelength  source,  the  beat  signal  that  results  at  the  output  of  the  interferometer  is  caused  by  the 
wavelength  (or  frequency)  difference  between  the  two  signals.  This  difference  frequency  is  related  to  the  delay 
difference  between  the  two  paths.  Furthermore,  the  difference  frequency  increases  proportionally  to  an  increase  in  the 
delay  difference  between  the  two  paths.  Figure  9  demonstrates  the  OCT  measurement  for  various  delay  differences 
using  the  47  nm  wavelength  sweep  of  Fig.  3  at  a  repetition  rate  of  100  KHz.  This  47  nm  sweep  provides  a  distance 
resolution  of  approximately  25.6  pm^.  The  experimental  results  demonstrate  that  the  spectrum  of  the  beat  signal 
broadens  and  the  amplitude  decreases  as  the  delay  difference  between  the  two  paths  increases.  For  delay  differences  of 
2  mm  or  less,  these  undesirable  effects  are  not  especially  severe.  No  efforts  were  made  to  eorreet  for  the  nonlinearity  of 
the  wavelength  sweep  in  this  measurement. 
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Figure  9:  OCT  measurements  for  the  47nm  wavelength  sweep  at  a  repetition  rate  of  100  KHz. 


OCT  Measurement  for  Various  Delays  with  a  47  nm  Wavelength 
Sweep  (Sweep  Rate:  100  KHz;  RBW:  10  KHz;  VBW:  3  KHz) 
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3.  CONCLUSION 

Fast  wavelength  sweeps  with  SG-DBR  lasers  have  been  demonstrated  by  applying  three  synehronized  arbitrary 
wavefonns  to  ihe  respective  tuning  inputs  of  the  laser.  The  short  cavity  length  and  small  capacitance  of  the  SG-DBR 
laser  device  allow  for  a  very  fast  wavelength-swept  source  for  optical  eoherenee  tomography  applications.  A  47  nm 
continuous  wavelength  sweep  was  demonstrated  at  user  adjustable  repetition  rates  between  0  to  1  MHz.  The  47  nm 
wavelength  sweeps  consists  of  a  concatenation  of  fifty  Inm  wide  continuous  tuning  segments.  The  fifty  concatenated 
sweep  segments  each  have  a  50  nS  wait  period  between  sweep  segments  during  which  the  output  of  the  SGDBR  laser  is 
stabilized.  An  overview  of  the  tuning  paths  that  arc  needed  to  drive  the  laser  was  given  resulting  in  a  scries  of  saw  tooth 
wavefonns  being  applied  to  the  front  mirror,  back  mirror  and  phase  sections  of  the  laser.  Useable  sweep  rates  up  to 
1  MHz  were  demonstrated  for  the  3.2  nm  narrow  sweep,  and  up  to  100  kHz  were  demonstrated  for  a  47  nm  wavelength 
sweep.  An  Optical  Coherence  Tomography  measurement  was  made  with  a  Miehclson  interferometer  measuring  the  air 
to  glass  interface  reflection  between  an  optical  fiber  and  air.  The  OCT  measurement  demonstrates  that  the  pcrfonnancc 
of  this  wavelength  sweep  is  adequate  for  imaging  up  to  2  millimeters  in  depth  into  a  sample  with  no  eorreetion  for 
wavelength  non-linearity  in  the  sweep. 
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Report  Section  2:  Generation  of  High  Speed,  Linear  Wavelength  Sweeps 
Using  Sampled  Grating  Distributed  Bragg  Reflector  Lasers 

Shane  O’Connor,  Michael  A.  Bemacil,  and  Dennis  Derickson 
California  Polytechnic  State  University  (Cal  Poly),  1  Grand  Avenue,  San  Luis  Obispo,  CA,  93407,  USA 

ABSTRACT  -  Wavelength-tunable  sampled  grating  distributed  Bragg  reflector  (SG-DBR)  lasers  are  used  for 
telecommunications  applications  in  which  the  laser  is  set  to  a  communication  channel  and  changed  infrequently.  SG-DBR 
lasers  can  be  tuned  to  any  wavelength  over  a  50  nm  tuning  range  with  fast  transition  times  using  a  set  of  three  control 
currents.  This  paper  demonstrates  generation  of  fast  linear  wavelength  ramps  covering  the  entire  tuning  range  of  the  laser. 
Continuous  and  linear  wavelength  sweeps  are  achieved  by  applying  three  time  synchronized  waveforms  to  the  front  mirror, 
back  mirror,  and  phase  sections  of  the  laser.  Continuous  wavelength  coverage  is  achieved  by  appending  50  separate  mode- 
hop-free  tuning  segments.  The  wavelength  stitching  transitions  require  a  maximum  of  60  ns  for  amplitude,  wavelength,  and 
thermal  settling  time  to  allow  the  laser  and  drive  electronics  to  equilibrate.  Full  band  wavelength  ramps  with  100  kHz 
repetition  rates  have  been  demonstrated.  An  example  FMCW  LIDAR  application  of  this  fast  wavelength  ramp  is  given. 

Index  Terms  -  Distributed  Bragg  reflector  lasers,  light  detection  and  ranging. 

I.  Introduction 

Sampled  grating  distributed  Bragg  reflector  (SG-DBR)  lasers  demonstrate  wavelength  switching  times  that  are  faster 
than  external  cavity  tunable  diode  lasers  or  fiber  ring  lasers  due  to  their  very  short  optical  cavity  length.  Experimental 
results  demonstrate  stepped-wavelength  switching  times  on  the  order  of  10  ns  for  the  phase  section  of  the  laser^ 

Continuous  wavelength  sweeps  are  achieved  by  mapping  the  wavelength  as  a  function  of  current  into  the  front 
mirror,  back  mirror,  and  phase  sections  of  the  laser.  The  wavelength  maps  are  used  to  find  tuning  paths  that  can  be 
concatenated  together  into  a  continuous  coverage  wavelength  ramp.  Arbitrary  waveform  generators  arc  used  to  drive  the 
front  mirror,  back  mirror,  and  phase  sections  of  the  SGDBR  laser  and  create  the  associated  linear  wavelength  ramp. 

A  Mach-Zehnder  Interferometer  is  used  to  experimentally  test  this  wavelength  sweep  for  high  speed  light  detection 
and  ranging  (LIDAR)  applications^.  The  results  reveal  that  short  range  LIDAR  measurements  at  sweep  rates  between  10 
and  80  kHz  demonstrate  a  distance  resolution  of  ±  45  pm  or  less. 

II.  Constructing  the  wavelength  sweep 

To  create  a  continuous  and  linear  wavelength  sweep,  the  three  tuning  sections  of  the  laser  must  be  controlled  with 
very  accurate,  time  synchronized  current  waveforms.  These  waveforms  are  obtained  by  first  analyzing  the  wavelength 
of  the  laser  as  a  function  of  the  front  and  back  mirror  bias  currents  as  shown  in  figure  1 . 


Front  Mirror  Current  (mA)  5  ^  ^  B.ck  Mirror  Current  (m A) 

Figure  3:  Mode  map  demonstrating  wavelength  as  a  function  of  front  mirror  and  back  mirror  bias  currents.  From  this  mode  map,  a  tuning  strategy  is 
obtained  to  generate  a  continuous  and  linear  wavelength  sweep  from  1523.3 17  nm  to  1570.078  nm. 
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Figure  1  illustrates  10  different  paths  that  ean  be  utilized  to  eover  the  full  wavelength  span  of  the  laser.  On  eaeh  path 
the  front  mirror  and  baek  mirror  eurrents  are  nearly  proportional.  The  phase  seetion  tuning  eurrent  is  not  ineluded  in  the 
map  of  Fig.  1 .  The  wavelength  of  the  laser  would  jump  in  0.2  nm  steps  if  the  phase  seetion  eurrent  of  the  laser  were 
eonstant.  The  0.2  nm  step  size  eorresponds  to  the  longitudinal  mode  spaeing  of  the  laser.  The  phase  seetion  ean  be 
utilized  to  electrieally  streteh  the  eavity  length  in  order  to  ereate  1.0  nm  wide  mode-hop  free  tuning  segments.  An 
example  tuning  segment  of  the  laser  for  path  5  is  given  in  figure  2. 


—  Phase 

—  Front  Mirror 

—  Back  Mirror 


Normalized  Time  (seconds) 

Figure  4;  Front  minor,  back  mirror,  and  phase  section  waveforms  that  drive  ihe  laser  along  path  5. 


The  front  and  baek  mirror  eurrents  are  proportional  but  parabolie  eurrent  versus  time  funetion  is  required  to  get  a 
linear  wavelength  versus  time  output.  The  phase  seetion  is  eleetrieally  stretehed  and  reset  6  times  over  the  duration  of 
this  tuning  path. 

Eaeh  path  illustrated  in  figure  1  has  a  path  width.  The  tuning  waveforms  are  designed  to  ensure  that  the  laser  is 
tuned  along  the  eenter  of  eaeh  tuning  path  to  prevent  mode  hops  throughout  the  sweep.  The  side  mode  suppression  ratio 
of  the  tunable  laser  wavelength  ramp  was  optimized  by  eharaeterizing  the  optimal  position  along  the  tuning  path. 

In  order  to  aehieve  wavelength  sweep  linearity,  the  three  synehronized  tuning  eurrents  are  mapped  in  0.1  nm 
inerements.  1  pm  wavelength  resolution  was  aehieved  by  linear  interpolation  between  the  bias  points.  Finally,  by 
eoneatenating  tuning  paths  in  the  speeifie  order  shown  in  Figure  1,  a  eontinuous  47  nm  wavelength  sweep  is  aehieved 
from  1523.317  nm  to  1570.078  nm. 

These  three  tuning  waveforms  are  uploaded  into  three  Agilent  33220A  Arbitrary  Waveform  Generators.  The 
waveform  generators  are  time  synehronized  using  an  external  trigger  input.  Frequeney  limitations  and  finite  switehing 
times  of  the  waveform  generators  result  in  wavelength  glitehes  at  eaeh  tuning  segment  eoneatenation  point.  Thermal 
settling  times  intensify  the  magnitude  of  the  wavelength  gliteh  at  these  transition  points.  Experimental  analysis 
demonstrated  that  a  maximum  of  60  ns  is  required  for  the  laser  and  drive  eleetronies  to  equilibrate. 


111.  Lidar  experiment 

Fig.  3  shows  an  experimental  set  up  to  observe  the  performanee  of  the  wavelength  sweep  for  LIDAR  applieations. 
The  swept  wavelength  output  of  the  laser  is  split  into  two  paths;  a  short  referenee  path,  and  a  long  delay  path.  These  two 
paths  are  then  eombined  to  ereate  a  beat  signal  that  relates  to  the  length  differenee  between  the  two  paths. 
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Figure  5:  The  laser  is  powered  by  the  D.C.  sources  and  the  wavelength  sweep  is  controlled  by  the  arbitrary  waveform  generators.  The  Mach-Zehnder 
Interferometer  provides  a  fiber  based  LIDAR  environment.  The  frequency  of  the  beat  signal,  which  relates  to  the  length  difference  between  the 
reference  path  and  delay  path,  is  measured  by  a  spectrum  analyzer. 


The  envelope  of  the  optical  beat  signal  is  converted  to  an  electrical  signal  at  the  output  of  a  photodetector.  This  signal  is 
then  amplified  and  measured  using  a  spectrum  analyzer. 

Figure  4  demonstrates  several  spectral  measurements  of  the  beat  signal  as  a  function  of  the  repetition  rate.  At  the 
10,  20,  50,  and  80  KHz  repetition  rates,  the  beat  signal  demonstrates  a  resolution  of  ±45,  40,  35,  and  25  millimeters 
respectively.  Though  the  theoretical  distance  resolution  of  the  47  nm  wavelength  sweep  is  approximately  25.6  pm\  the 
spectral  bandwidth  of  the  beat  signal  dominates  the  distance  resolution.  Furthermore,  the  spectrum  of  the  beat  signal  due 
to  a  50  KHz  and  80  KHz  repetition  rate  demonstrates  an  unusual  shape.  This  distortion  is  most  likely  attributed  to  both 
the  non-linearities  in  the  wavelength  as  a  function  of  time,  which  is  intensified  by  faster  sweep  rates,  and  the  bandwidth 
limitations  of  the  arbitrary  waveform  generators. 
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Figure  6;  LIDAR  mcasuremenis  for  a  0.3  m  delay  line  at  sweep  rates  ranging  from  10  KHz  to  80  KHz  (left  to  right  respectively).  The  LIDAR 
measurements  are  contained  within  optical  fiber  using  an  FMCW  architecture. 


IV.  Conclusion 

Fast  wavelength  sweeps  with  SG-DBR  lasers  have  been  demonstrated  by  applying  three  synehronized  arbitrary 
waveforms  to  the  respeetive  tuning  inputs  of  the  laser.  Mapping  the  wavelength  as  a  funetion  of  the  three  tuning 
eurrents  and  appending  the  tuning  segments  results  in  a  47  nm  eontinuous  wavelength  sweep.  Performing  LIDAR 
measurements  using  a  Maeh-Zehnder  Interferometer  demonstrates  that  short  range  distanee  measurements  at  update 
rates  between  10  and  80  KHz  provides  distanee  resolutions  between  ±  45  and  ±  25  mierometers. 
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REPORT  SECTION  3:  MICROWAVE  SIGNAL  GENERATION  USING  SINGLE-CHIP  FAST 
WAVELENGTH-TUNABLE  SAMPLED  GRATING  DISTRIBUTED  BRAGG  REFLECTOR  LASERS 


Michael  A.  Bernacil,  Shane  O’Connor,  Ben  Maher,  Andrew  Dekelaita,  and  Dennis  Derickson 


ABSTRACT  —  MICROWAVE  SIGNAL  GENERATION  USING  SINGLE-CHIP  FAST  WAVELENGTH- 
TUNABLE  SAMPLED  GRATING  DISTRIBUTED  BRAGG  REFLECTOR  (SG-DBR)  LASERS  IS 
DEMONSTRATED.  MICROWAVE  SIGNALS  ARE  ESTABLISHED  BY  A  SELF-HETERODYNE 
TECHNIQUE.  THE  LASER  FREQUENCY  IS  SQUARE-WAVE  MODULATED  BACK  AND  FORTH 
BETWEEN  TWO  CLOSELY  SPACED  WAVELENGTHS.  THESE  TWO  WAVELENGTHS  ARE  MADE  TIME 
COINCIDENT  USING  A  FIBER  MACH-ZEHNDER  INTERFEROMETER.  THE  DIFFERENCE 
FREQUENCY  IS  DETECTED  AND  AMPLIFIED.  MICROWAVE  SIGNALS  UP  TO  12  GHZ  HAVE  BEEN 
MEASURED  BY  FREQUENCY  MODULATING  THE  PHASE  SECTION  OF  THE  SG-DBR  LASER. 
MILLIMETER  WAVE  DIFFERENCE  FREQUENCIES  ARE  EASILY  AVAILABLE  FROM  THE  SG-DBR 
LASER.  MICROWAVE  SIGNAL  SPECTRAL  WIDTHS  AS  NARROW  AS  10  MHZ  HAVE  BEEN  ACHIEVED 
FOR  LOW  BACK  MIRROR  CURRENT  INPUTS.  SPECTRAL  WIDTH  RESULTS  AS  A  FUNCTION  OF 
DEVICE  DC  BIAS  CONDITION  ARE  PRESENTED.  TIME  RESOLVED  FREQUENCY  STEP 
MEASUREMENTS  OF  A  HIGH-SPEED  PACKAGED  DEVICE  HAS  SHOWN  40NS  WAVELENGTH 
SWITCHING  TIMES  DOMINATED  BY  THE  SPEED  OF  THE  ELECTRICAL  DRIVING  SOURCE. 

INDEX  TERMS  —  DISTRIBUTED  BRAGG  REFLECTOR  LASERS,  DISTRIBUTED  FEEDBACK  LASERS, 
MICROWAVE  GENERATION,  MICROWAVE  OSCILLATORS,  MILLIMETER  WAVE  GENERATION, 
OPTICAL  SELF-HETERODYNING  SEMICONDUCTOR  LASERS,  WAVELENGTH  TUNABLE  LASERS. 


1.  INTRODUCTION 

Tunable  diode  lasers  are  currently  the  focus  of  much  attention  in  the  telecommunications  industry,  as  they  arc 
expected  to  become  essential  components  for  the  next  generation  of  dense  wavelength  division  multiplexing  systems  [1]. 
Sampled-grating  distributed  Bragg  reflector  (SG-DBR)  single-chip  tunable  lasers  have  emerged  as  a  dominant  solution 
to  wavelength-agile  fiber  optic  communication  systems.  These  3  mm  long  diode  laser  chips  can  tune  over  the  entire 
1525  to  1565  nm  telecommunication  band  with  three  current  inputs  controlling  the  laser  wavelength.  SG-DBR  lasers 
offer  many  desirable  features  such  as  fast  switching  times,  good  side  mode  suppression  ratios  (ratios  >  40  dB),  broad- 
wavelength  tuning  ranges  of  approximately  50  nm  (1520  -  1570  nm  or  1570  -  1610  nm),  as  well  as  lasing  stability  and 
repeatability.  Previous  research  into  SG-DBR  lasers  has  led  to  demonstrations  of  fast  wavelength  switching  capabilities 
of  fewer  than  5-ns  for  a  64-channel  laser  with  switching  accuracy  of  ±12  GHz  [2]. 

The  fast  wavelength  switching  characteristics  and  wide  tuning  range  of  the  SG-DBR  laser  can  be  utilized  for 
microwave  signal  generation.  Fig.  1  shows  a  block  diagram  illustrating  the  basic  approach  that  is  used.  The  SG-DBR 
laser  has  its  operating  frequency  determined  by  currents  applied  to  the  laser.  A  low  frequency  square  wave  modulation 
with  fast  transitions  is  applied  to  the  laser  resulting  in  a  square  wave  modulated  optical  frequency  versus  time.  The 
square  wave  modulated  optical  signal  is  applied  to  a  Mach-Zehnder  interferometer.  The  long  delay  path  of  the 
interferometer  is  chosen  to  be  equal  to  half  the  period  of  the  square  wave  modulation  signal. 
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Fig.  1.  The  block  diagram  used  to  generate  microwave  signals  using  SG-DBR  lasers  is  shown.  The  laser  is  current  modulated  (a) 
with  a  square  wave  current  waveform.  A  square  wave  optical  frequency  versus  time  (b)  results.  T  he  output  of  the  interferometer  (c) 
has  the  two  optical  frequencies  present  at  the  same  time.  The  difTerence  frequency  (d)  is  photodetected  (e)  and  applied  to  the 
electrical  spectrum  analyzer  for  analysis  (f). 

Using  this  self-heterodyne  approach,  microwave  and  millimeter  wave  signals  ean  be  generated  using  a  low  frequency 
square  wave.  Photodeteetor  bandwidth  measurements  can  be  made  using  this  self-heterodyne  signal  as  the  excitation 
source.  This  compact  source  can  frequency  hop  with  sub-microsecond  update  rates  over  arbitrary  frequency  patterns 
from  DC  to  the  millimeter  wave  bands.  The  frequency  range  and  power  of  the  microwave  and  millimeter  wave 
signals  arc  limited  by  the  photodeteetor  characteristics.  Photodeteetor  structures  with  several  hundred  GHz 

bandwidth  should  enable  signal  generation  beyond  the  range  of  traditional  mierowave  sourees  and  frequeney  multiplier 
circuits.  A  limitation  on  the  usefulness  of  these  sources  in  applications  is  presently  the  spectral  width  of  the  optical 
sources  used  for  self-heterodyne.  Section  II  will  contrast  this  work  to  previous  examples  of  signal  generation  by  self- 
heterodyne  methods. 

11.  MICROWAVE  SIGNAL  GENERATION 
USING  SELF-HETERODYNE  REVIEW 

The  self-heterodyne  method  for  mierowave  signal  generation  described  in  this  paper  was  initially  described  in 
references  [3],  [4],  and  [5].  References  [3]  and  [4]  used  a  distributed  feedback  laser  in  a  self- heterodyne  configuration 
similar  to  that  shown  in  Fig.  1 .  Triangular  and  rectangular  current  waveforms  were  injected  into  the  laser  bias.  The 
distributed  feedback  laser  produced  both  intensity  and  frequeney  changes  in  response  to  the  current  waveforms. 
Microwave  signals  up  to  4  GHz  were  reported.  Reference  [4} reported  on  the  use  of  SG-DBR  lasers  using  the  self- 
heterodyne  configuration  of  Fig.  1.  Frequencies  as  with  R  (FM)  that  was  applied  to  the  Mach-Zehnder  interferometer. 
The  optical  frequency  difference  frequency  was  photodetected  and  the  generated  mierowave  signals  were  observed  with 
an  electrical  spectrum  analyzer.  Reference  [4]  demonstrated  self-heterodyne  microwave  generation  with  a  full-band 
wavelength  tunable  SG-DBR  laser.  The  SG-DBR  approach  utilized  only  FM  modulation  and  showed  dramatically 
reduced  microwave  signal  spectral  width.  Self-heterodyne  of  a  dual-wavelength  fiber  laser  has  also  been  reported  [5]. 

Optically  injection  locked  semiconductor  lasers  have  recently  been  used  in  photonic  mierowave  generation  [6].  A 
common  method  of  generating  mierowave  signals  from  optical  components  utilizes  a  master-slave  laser  arrangement.  In 
a  master-slave  configuration  with  sufficient  injection  power,  the  optical  frequeney  of  the  slave  laser  is  injection  locked  to 
that  of  the  master  laser.  By  properly  adjusting  the  injection  strength  and  the  frequeney  detuning,  instability  occurs 
through  Hopf  bifurcation  into  the  period-one  dynamical  state.  The  result  is  a  tunable  mierowave  oscillation  dependent 
on  the  optical  power  of  the  slave  laser  [6]. 
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A  third  category  used  to  create  microwave  signals  is  based  on  an  external  modulation  technique.  The  external 
modulator  ean  either  be  an  eleetro-optie  intensity  modulator  or  a  phase  modulator.  A  system  that  eould  generate 
millimeter-wave  signals  using  an  external  intensity  modulator  was  proposed  in  1992  by  O’Reilly  et  al.  [7].  A  frequency- 
doubled  electrical  signal  was  optically  generated  by  biasing  the  intensity  modulator  to  suppress  the  optical  carrier  and 
the  even-order  optical  sidebands.  A  36  GHz  millimeter-wave  signal  was  generated  when  the  intensity  modulator  was 
driven  by  an  18  GHz  microwave  signal.  A  key  advantage  of  this  approach  is  that  frequency-doubled  signals  ean  be 
generated  with  a  relatively  low-speed  external  modulator.  However,  similar  to  approaches  in  the  first  category,  a  high 
quality  microwave  reference  source  is  required  [7]. 


III.  SG-DBR  LASER  CHARACTERISTICS 

The  laser  chosen  for  this  work  was  the  JDSU  Ine.  MKS-063-B  widely  tunable  laser  that  was  internally  modified  by  the 
manufacturer  to  allow  for  fast  wavelength  switching.  Fig.  2  shows  a  top  view  of  the  SG-DBR  laser  diode  chip  used  in 
the  experiments.  This  laser  chip  has  five  segments  requiring  separate  current  biases.  The  gain  section  provides  for  the 
amplification  needed  to  obtain  stimulated  emission.  The  back  mirror  and  front  mirror  form  eurrent-eontrolled 
wavelength  dependent  reflectivity  to  tune  the  wavelength  of  the  laser.  The  phase  section  performs  fine  “eurrent- 
eontrolled  stretching”  of  the  laser  cavity  to  make  small  adjustments  in  the  wavelength  of  the  laser.  The  semiconductor 
optical  amplifier  (SOA)  adjusts  the  laser  output  power. 
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Fig.  2.  Top  view  of  the  SG-DBR  laser  utilized  in  this  experiment:  The  magnitude  of  currents  driving  the  back  mirror  (a),  front  mirror 
(d),  and  phase  segment  (c)  control  the  wavelength  of  the  laser.  The  gain  section  (b)  and  semiconductor  optical  amplifier  (e)  control 
the  laser  output  power. 


SG-DBR  single-ehip  monolithic  tunable  lasers  were  originally  developed  for  telecommunication  applications.  These 
devices  allow  for  a  wide  wavelength  tuning  range  over  the  erbium-doped  fiber  amplifier  operational  band  of  1525  to 
1565  nm,  or  the  extended  L-band  of  1565  to  1605  nm.  References  [1],  [2],  and  [8]  provide  illustrations  of  the  device 
design  and  the  mechanism  of  wavelength  control  in  the  SG-DBR  laser.  Similar  single  chip  tunable  lasers  such  as  the  Y- 
Junetion  variant  are  also  suitable  for  this  application  [9]. 

Fig.  3  illustrates  tuning  characteristics  for  the  device  used  in  the  experiments  of  this  paper.  The  wavelength  as  a  function 
of  the  front  mirror  and  back  mirror  currents  are  given.  The  phase  section  current  is  held  constant  at  5.5  mA  in  the 
measurement.  In  order  to  get  a  smooth  change  of  frequency  as  a  function  of  bias,  one  must  increment  the  front  mirror 
and  back  mirror  currents  simultaneously.  A  series  of  paths  where  the  laser  wavelength  can  be  continuously 
tuned  is  shown  in  Fig.  3.  One  has  to  concatenate  paths  in  order  to  cover  the  complete  frequency 
band  of  the  SG-DBR  laser.  The  microwave  signals  generated  in  this  work  involve  tuning  between 
wavelengths  on  a  single  path  of  the  laser-tuning  curve. 
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Fig.  3.  A  Three-dimensional  view  of  the  SG-DBR  wavelength  tuning  eharacteristics  is  giv  en.  The  horizontal  axes  represent  the 
eurrent  drive  to  the  front  mirror  and  back  mirror  segments  of  the  laser.  The  phase  current  is  held  constant  at  5.5  mA.  The  illustrated 
paths  show  regions  where  a  continuous  change  in  wavelength  is  available.  Path  1:  1565  -  1560  nm;  Path  2:  1560  -  1555  nm;  Path  3: 
1555  -  1550  nm;  Path  4:  1550  -  1545  nm;  Path  5:  1545  -  1540  nm.  The  horizontal  arrows  represent  the  1  nm  ‘tiled'  regions  between 
wavelength  paths 


Any  laser  output  wavelength  from  1525  to  1565  nm  ean  be  produeed  by  generating  a  wavelength  tuning-look  up  table 
that  utilizes  eun'ent  ehanges  in  the  front  mirror,  baek  mirror  and  phase  segments  of  the  SG-DBR  laser.  For  mierowave 
signal  generation,  only  a  small  wavelength  ehange  is  neeessary.  The  entire  laser  tuning  range  eorresponds  to  a 
frequeney  difTerenee  of  5  THz.  This  self-heterodyne  method  will  utilize  very  small  wavelength  ehanges  to  provide 
differenee  frequeneies  in  the  mierowave  and  millimeter  wave  bands.  The  front  mirror,  baek  mirror  and  the  phase  seetion 
are  the  wavelength  eontrol  segments  of  the  laser.  Fig.  4  shows  the  DC  tuning  eurves  of  the  front  mirror,  baek  mirror 
and  phase  seetion  of  the  laser.  Both  the  optical  power  and  frequeney  are  shown  as  a  function  of  DC  bias.  The  front 
mirror  and  back  mirror  currents  show  the  5  nm  wide  stair-step  wavelength  changes  that  occur  when  traversing  the  tuning 
curve  in  Fig.  3  with  only  one  current  changing.  The  phase-section  tuning  curve  is  of  particular  interest  in  that  only  a 
small  wavelength  range  is  covered.  The  phase  section  output  power  is  also  only  slightly  dependent  on  the  phase  seetion 
bias  current.  The  output  power  changed  by  only  0.2  dB  over  most  of  the  phase  section  tuning  range.  Microwave  signal 
generation  using  self-heterodyne  has  been  accomplished  using  the  front  mirror,  back  mirror  and  phase  sections. 
Modulation  of  the  phase  section  is  the  focus  of  this  paper.  Square  wave  current  modulation  of  only  a  few  milliamps  in 
the  phase  section  is  required  to  produce  difference  frequencies  in  the  microwave  and  millimeter  frequency  ranges  up  to 
60  GHz. 
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Fig.  4.  (a)  The  wavelength  and  optical  power  as  a  function  of  current  applied  to  the  front  mirror  is  shown.  The  other 
laser  segments  arc  biased  as  follows;  back  mirror:  30  mA,  phase  section:  5.5  mA,  gain:  100  mA,  SOA:  150  mA.  (b)  The 
wavelength  and  optical  power  as  a  function  of  current  applied  to  the  back  mirror  is  shown.  The  other  laser  segments  are 
biased  as  follows;  front  mirror  current:  20  mA,  phase  section:  5.5  mA,  gain:  100  mA,  SOA:  150  mA.  (c)  The 
wavelength  and  optical  power  as  a  function  of  current  applied  to  the  phase  section  is  shown.  The  other  laser  segments 
arc  biased  as  follows;  front  mirror  current:  20  mA,  back  mirror  current:  30  mA,  gain:  100  mA,  SOA:  150  mA.  These 
three  graphs  illustrate  the  course  tuning  (front  mirror  and  back  mirror)  and  fine  tuning  control  (phase  section)  of  the  SG- 
DBR  laser.  The  back  mirror,  front  mirror  and  gain  segments  primarily  control  the  wavelength  and  produce  a  small 
amount  of  change  in  the  optical  power.  The  phase  section  offers  continuous  wavelength  tuning  over  a  narrow  range. 
The  front  mirror  and  back  mirror  offer  discontinuous  tuning  (typically  in  5  nm  steps)  over  the  full  range  of  the  laser. 


IV.  Microwave  signal  generation 

Fig.  6  shows  the  measurement  diagram  and  initial  results  for  microwave  signal  generation  using  self-heterodyning 
of  an  SG-DBR  laser.  The  output  of  the  laser  is  coupled  into  a  single  mode  fiber  pigtail  and  sent  into  a  Mach-Zehnder 
interferometer  with  a  3.5  ps  path  time  delay  difference.  A  square  wave  drive  current  with  a  repetition  frequency  of 
l/(7ps)  was  applied  to  the  phase  section  of  the  SG-DBR  laser.  The  square  wave  current  modulation  causes  the  laser  to 
switch  back  and  forth  between  two  adjacent  optical  frequencies.  The  long  delay  path  of  the  interferometer  builds  up  a  0 
to  3.5  Us  time  record  at  X  i.  The  current  drive  then  forces  the  laser  to  ^  2  the  3.5  ps  to  7  ps  portion  of  a  modulation 
period.  The  output  of  the  Mach-Zehnder  interferometer  therefore  has  X  1  and  X  2  overlapping  in  time.  The  interferometer 
beats  the  two  switching  optical  frequencies  together  and  the  resulting  output  of  the  photodetector/preamplier  is  a 
sinusoid  at  the  difference  frequency  [4]. 

The  linewidth  of  the  laser  source  is  a  key  parameter  controlling  the  spectral  width  of  the  microwave  difference 
frequency  output.  Fig.  7a  shows  the  results  of  a  homodyne  measurement  of  the  laser  linewidth  for  the  case  of  no  applied 
square  wave  modulation.  The  homodyne  difference  frequency  is  centered  at  0  Hz.  The  -  3  dB  bandwidth  of  the  signal 
centered  at  DC  is  28.7  MHz.  This  unmodulated  width  represents  a  limit  to  the  width  of  microwave  signals  generated  in 
the  self-heterodyne  case  since  laser  linewidth  typically  increases  under  modulation. 
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Fig.  6b  and  6c  presents  examples  of  microwave  signals  generated  via  self-heterodyning  the  laser  output.  The 
measurement  set  up  for  these  results  is  shown  in  figure  6d.  All  segments  except  for  the  phase  section  arc  DC  biased. 

The  phase  section  has  a  143  kHz  square  wave  eurrent  modulation  with  varying  levels  of  amplitude.  The  highest 
frcqueney  mierowave  signals  measured  were  at  12  GHz.  This  frequeney  was  limited  by  our  photodeteetor  and  amplifier 
inventory. 
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Fig.  6.  (a)  The  self-homodyne  linewidth  of  the  signal  is  shown,  back  mirror:  30  mA,  front  mirror:  20  mA,  phase:  5.5  mA,  gam:  100 
mA,  SOA:  150  mA.  (b)  Low  frequency  microwave  signals  generated  via  delayed  self-heterodyning.  The  top  number  in  each  box  is 
the  DC  bias  current  on  the  phase  section  and  the  bottom  number  is  the  3  dB  spectral  width,  (c)  High  frequency  microwave  signals 
generated  via  delayed  self-heterodyning  (d)  Experimental  setup  for  obtaining  delayed  homodyne  or  sclf-hctcrodync  spectrum  from  the 
Mach-Zehnder  inierferomctcr  output.  The  spectrum  analyzer  resolution  bandwidth  is  3  MHz  for  all  measurements. 


The  average  linewidth  of  the  laser  measured  from  the  low  frequeney  mierowave  signals  is  approximately  23  MHz, 
and  the  average  linewidth  measured  from  the  high  frequency  microwave  signals  is  approximately  40  MHz.  The  data 
shows  that  the  higher  the  modulation  current  amplitude,  the  broader  the  linewidth.  However,  these  results  show 
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consistency  between  the  unmodulated  and  modulated  linewidth  measurements.  The  28  MHz  measured  linewidth  from 
the  homodyne  signal  of  fig.  6a  is  roughly  between  23  and  40  MHz, 


It  is  expected  that  the  linewidth  of  the  laser  will  be  increased  under  modulation  compared  to  the  unmodulated  case. 
Linewidth  broadening  can  occur  due  to  low  frequency  temperature  transients  during  wavelength  switching,  broadband 
noise  coupling  into  the  frequency  modulation  segments  and  the  stability  of  the  current  sources  switching  the  wavelength 
of  the  laser.  The  linewidth  of  the  laser  is  also  dependent  on  the  DC  bias  condition  of  the  laser.  Fig.  7  shows  a  map  of 
the  variations  in  measured  linewidth  and  its  dependency  on  front  and  back  mirror  current  tuning.  The  linewidth  was 
measured  using  the  homodyne  method  shown  in  figure  6a.  The  narrowest  linewidth  signals  are  found  when  small 
currents  arc  applied  to  the  front  and  back  mirror  segments. 
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Fig.  7.  Two-dimensional  tuning  map  identifying  areas  where  laser  linewidth  is  greater  than  75  MHz  and  less  than  10  MHz.  Both 
unmodulated  homodyne  results  (Horn  LW)  and  modulated  self-heterodyne  (Het  LW)  results  are  indicated.  The  regions  enclosed  by 
the  dashed  ovals  had  the  narrowest  linewidth  results 


A  heavy  concentration  of  10  MHz  measured  linewidths  occurs  when  the  DC  bias  of  the  back  mirror  is  between  0  and  5 
mA.  The  linewidth  is  less  dependent  on  front  mirror  bias  condition.  The  microwave  signal  generation  method  discussed 
in  this  work  only  requires  a  small  wavelength  change  around  a  DC  operation  point  established  by  the  front  mirror  and 
back  mirror  bias.  Fig.  7  shows  that  there  are  specific  bias  points  for  narrowest  spectral  width  microwave  signal 
generation. 


V.  High  speed  package  and  response  measurements 

SG-DBR  lasers  were  originally  designed  for  telecommunication  applications  that  did  not  utilize  the  fast  wavelength 
switching  capabilities  of  the  laser.  Most  telecommunication  applications  utilize  integrated  low  pass  filters  into  the  laser 
package  in  order  to  minimize  the  potential  for  externally  introduced  noise  affecting  the  spectral  content  of  the  laser. 
However,  for  applications  requiring  fast  wavelength  switching,  such  as  microwave  signal  generation,  it  is  necessary  to 
remove  the  low  pass  filters.  Fig.  8  shows  a  close  up  of  the  packaged  SG-DBR  laser  assembly.  Semi-rigid  coaxial  cables 
are  connected  to  the  pins  of  the  butterfly  package  to  maximize  coupling  of  fast  switching  time  square  wave  waveforms 
to  the  laser. 
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Fig.  8.  A  modified  14-pin  butterfly-packaged  packaged  laser  with  internal  low  pass  filters  removed  is  shown.  The  leads  arc  fed  with 
0.085-inch  diameter  semi-rigid  coaxial  cable  to  allow  high-speed  (modulation)  drive  of  the  dev  ice. 


The  butterfly  leads  were  suspended  over  an  RT-Duroid  dieleetrie  surface  to  create  an  environment  close  to  50  Q  in 
the  butterfly  package  leads.  For  heat  sink  purposes,  the  entire  unit  was  mounted  onto  an  aluminum  block. 

The  frequency  modulation  response  of  the  laser  was  tested  to  determine  the  potential  wavelength  switching  speed. 
Fig.  9  shows  the  apparatus  that  was  used  to  measure  the  FM  frequency  response  of  the  packaged  laser.  A  sinusoidal  AC 
current  waveform  was  applied  to  the  phase  section  of  the  laser  inducing  sinusoidal  frequency  modulation  at  the  laser 
output.  The  laser  output  was  then  applied  to  a  0. 1  nm  passband  width  band  pass  filter.  The  laser  output  was  aligned  to 
the  skirt  of  the  filter  lower  in  wavelength  than  the  pass  band  peak.  As  a  result,  the  optical  wavelength  was  offset  from 
the  wavelength  of  maximum  transmission.  An  FM  to  intensity  modulation  converter  is  formed  by  the  band  pass  filter 
skirt.  By  changing  the  frequency  of  the  sinusoidal  modulation  eurrent  waveform,  the  frequeney  modulation  response  of 
the  laser  was  obtained.  The  photodctcctor  senses  the  intensity  modulation  and  applies  it  to  an  electrical  spectrum 
analyzer.  The  FM  frequency  response  measurement  shown  in  Fig.  10  indicates  that  the  laser  package  can  be  efficiently 
modulated  up  to  100  MHz. 
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Fig.  9.  The  experimental  setup  used  to  measure  FM  modulation  effieieney  is  shown.  A  wavelength  tunable  band  pass  filter  (BPF) 
was  adjusted  so  that  the  laser  wavelength  was  on  the  skirt  of  the  filter.  The  BPF  serves  as  a  wavelength  diseriminator  eonverting 
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frequency  modulation  into  intensity  modulation.  The  frequency  deviation  as  a  function  of  the  sinusoidal  current  modulation  to  the 
phase  section  was  measured. 


s 

^  Modulation  Frequency  (kHz) 


Fig.  10.  The  frequency  modulation  (FM)  efficiency  of  the  phase  segment  of  the  SG-DBR  laser  with  respect  to  modulation  frequency 
is  shown.  Fig.  9  showed  the  measurement  set  up.  Efficient  modulation  frequencies  up  to  100  MFIz  were  demonstrated. 


VI.  time  resolved  frequeney  performance 

Linewidth  broadening  under  square  wave  modulation  is  a  fundamental  concern  for  narrow  spectral  width  microwave 
signal  generation.  A  time  resolved  frequeney  step  measurement  was  performed  to  quantify  the  time  interval  over  which 
the  microwave  signal  is  off,  and  to  identify  a  mechanism  for  microwave  signal  broadening  above  the  unmodulated 
linewidth  performance  of  the  laser.  The  experimental  setup  for  the  time  resolved  experiment  was  similar  to  the 
frequeney  respone  measurement  setup  shown  in  Fig.  9  with  an  oscilloscope  replacing  the  spectrum  analyzer.  The  square 
wave  current  modulation  was  directly  coupled  to  the  phase  section  of  the  laser. 

A  time  resolved  frequeney  measurement  result  is  shown  in  Fig.  11.  The  laser  output  was  placed  at  a  wavelength  that 
was  longer  than  that  of  the  filter  passband  for  measurement  A.  The  bandpass  filter  acts  as  a  wavelength  discriminator 
turning  frequency  changes  into  inensity  changes  that  are  photodetected  and  measured  on  the  oscilloscope.  The  process 
was  repeated  with  the  laser  wavelength  placed  shorter  than  the  filter  passband  in  position  B.  In  position  C  the  laser  was 
placed  at  the  center  of  the  passband  where  FM  to  intensity  modulation  is  minimized.  The  circles  in  fig.  1 1  highlight 
thermal  transients  effecting  the  frequeney  switching  time  of  the  laser.  The  transients  have  been  identified  to  be  on  the 
order  of  200  ns  in  duration.  The  presence  of  thermal  transients  broadens  the  width  of  the  microwave  signal  generated  by 
the  self  heterodyne  technique. 


Time  (|aS) 


Fig.  11.  Optical  frequency  as  a  function  of  time  for  a  square  wave  current  modulation  at  143  kHz  is  shown.  The  circled  regions 
highlight  the  overshoot  locations  of  the  optical  frequency  caused  by  thermal  transients.  Trace  A  is  for  the  case  of  the  laser  wavelength 
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positioned  longer  that  the  filter  passband.  Trace  B  if  for  positioning  shorter  than  the  filter  passband.  Trace  C  is  for  centering  of  the 
laser  on  the  filter  passband. 

The  switching  time  of  the  SG-DBR  laser  was  also  observed  from  the  time  resolved  step  measurement.  Fig.  12 
shows  the  transition  time  between  the  two  optical  wavelengths.  A  wavelength  switching  time  of  approximately  40  ns 
was  observed.  This  time  is  dominated  by  the  the  rise  time  of  the  applied  current  modulation  waveform. 


(B) 


Fig.  12.  The  frequency  versus  time  is  shown  near  the  transition  point  of  the  square  wave  modulated  laser.  The  circled  area  show  s  the 
switching  time  between  sequential  optical  frequencies.  Trace  A  is  for  the  case  of  the  laser  wavelength  positioned  longer  that  the  filter 
passband.  Trace  B  if  for  positioning  shorter  than  the  filter  passband.  Trace  C  is  for  centering  of  the  laser  on  the  filter  passband. 

Recall  from  [2],  switching  times  of  5  ns  have  been  achieved  for  this  class  of  diode  lasers.  However,  these  results 
were  obtained  only  under  pre-emphasis  switching  conditions  where  amplitude  overshoot  or  undershoot  conditions  of  the 
RF  current  square  waveform  were  nonlinearly  emphasized.  Recalling  the  frequency  response  measurements  presented 
in  Fig.  10,  switching  times  on  the  order  of  10  ns  (1/lOOMHz)  should  be  possible.  The  microwave  signals  generated  by 
this  method  thus  are  continuous  wave  with  the  exception  of  the  the  40  ns  switching  time  of  the  laser  wavelength  output. 


VII.  CONCLUSION 

Microwave  signal  generation  using  a  single  wavelength  tunable  SG-DBR  laser  has  been  demonstrated.  This 
technique  does  not  require  a  master  laser  synchronized  to  a  slave  laser,  an  external  microwave  drive  source,  or  a  mode- 
locked  laser.  Microwave  signals  up  to  12  GHz  have  been  demonstrated.  Linewidth  measurements  have  been  taken  from 
the  delayed  self- homodyne  signals  showed  spectral  widths  between  22  and  53  MHz.  Extensive  linewidth 
characterization  was  performed  to  show  optimal  bias  conditions  for  the  SG-DBR  laser  segments  in  order  to  generate 
microwave  signals. 

A  high  frequency  laser  package  was  designed  to  minimize  the  transition  time  during  wavelength  switching. 
Frequency  domain  and  time-resolved  frequency  response  experiments  were  performed  to  characterize  the  packaged  laser 
response.  Wavelength  switching  times  of  40  ns  were  produced. 
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Summary: 

This  report  gave  a  summary  of  the  work  done  by  Dennis  Deriekson,  Brandon  George,  Ben  Maher,  Shane  O'Connor, 
Mike  Bemaeil  and  Andrew  Dckelaita  in  over  the  period  of  Jan  2008  to  Dee.  2008.  Table  I  below  gives  a  high  level 
summary  of  the  work  with  4  areas  highlighted.  The  signifieanee  to  the  offiee  of  Naval  Researeh  is  also  summarized. 
This  report  essentially  eontains  the  results  of  four  papers  that  were  published  over  this  time  period.  If  a  more  detailed 
aeeount  of  the  work  is  desired,  a  set  of  four  Master’s  thesis  doeuments  are  eited  below. 


Table  1:  The  key  outcomes  of  this  work  are  highlighted  in  the  following  summary  table  along  with  the  associated 
relevance  to  the  project  sponsor. 


Item 

Discussion 

Signiflcancc  to  the  Office  of 
Naval  Research 

LIDAR 

The  initial  proposal  for  this  project  was  to  demonstrate 
Sample  Grating  Distributed  Bragg  Reflector  Laser's 
applications  for  LIDAR  systems.  Section  2  of  this  report 
highlights  the  LIDAR  results  that  were  achieved  and  reported 
at  the  IEEE  LEGS  annual  meeting. 

A  small  size,  inexpensive,  fast  update 
rate,  swept  wavelength  lasers  source 
was  demonstrated  for  the  LIDAR 
application.  This  device  should  be 
important  for  portable  LIDAR  systems 
where  fast  update  rate  is  essential. 

OCT 

This  same  high  repetition  rate  source  was  used  for  optical 
coherence  tomography  measurements.  Section  1  of  this  report 
highlights  the  investigation  results.  This  work  was  reported  at 
SPlE’s  photonics  west  conference  in  January  of  2009. 

OCT  is  becoming  an  important  method 
of  non-invasivc  examination  of 
reflectivity  versus  distance  in  biological 
samples.  The  significance  of  this  work 
is  demonstrating  that  an  inexpensive 
portable  laser  source  ean  work  in  OCT 
applications. 

Microwave 

Signal 

Generation 

Section  3  of  the  report  shows  that  these  fast  tunable  lasers 
have  application  to  generation  of  microwave  and  millimeter 
wave  signals. 

Optical  methods  of  generating 

millimeter  wave  signals  with  a  delayed 
self  heterodyne  technique  arc  shown. 
This  source  along  with  high  speed 
optical  detectors  eould  be  a  viable 
method  for  signal  generation  in  the 
100s  of  GHz  region. 

Optical 

Sensing 

Interrogation 

The  fast  sweep  time  of  the  SGDBR  tunable  laser  allows  for 
10  jiS  time  resolution  of  optical  sensors. 

This  work  allows  for  a  significant 
advancement  in  time-resolved 

measurements  of  optical  sensors  which 
rely  on  changes  in  the  frequency 
response. 
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Project  title;  An  experimental  and  theoretieal  study  of  the  eleetro-optieal  response  of 
a  new  type  of  ferroeleetrie  liquid  erystal 

Project  aim:  The  aim  of  this  eollaborative  projeet  is  to  eonduet  a  threefold 
investigation  of  a  teehnologieally  promising  elass  of  ferroeleetrie  liquid  erystals, 
known  as  de  Vries  liquid  erystals,  whieh  exhibit  a  eolossal  eleetro-optieal  response. 
The  unusual  eleetro-optieal  properties  of  these  de  Vries  materials  have  generated 
signifieant  interest  for  their  potential  use  in  liquid  erystal  displays  and  photonie 
deviees.  This  projeet  will  simultaneously  proeeed  on  three  fronts,  two  experimental 
and  one  theoretieal.  Dr  Femsler  will  experimentally  investigate  the  relationship 
between  the  eleetro-optieal  response  of  the  materials  and  their  orientational  order.  Dr 
Barjami  will  eonduet  ealorimetrie  measurements  on  different  materials  to  eorrelate 
thermodynamie  nature  of  the  smeetie  A-C  transition  with  the  size  of  the  optieal 
response.  Dr  Saunders  will  use  an  established  theoretieal  model  to  gain  insight  to  the 
intereonneeted  relationships  between  the  optieal  response,  orientational  order  and 
thermodynamie  nature  of  the  A*-C*  transition.  Combining  the  results  of  these  three 
investigations  will  provide  unpreeedented  insight  to  these  materials,  partieularly  in 
their  ineorporation  and  optimization  for  eleetro-optieal  deviees 

Summary 

Results 


Optical  Response  and  Orientational  Order  (Dr  Fernsler) 

Considerable  progress  has  been  made  in  the  eleetro-optie  measurements  of  de  Vries 
liquid  erystals  and  some  surprising  results  have  led  us  to  pursue  additional 
investigations.  Three  Cal  Poly  undergraduate  students  have  built  the  apparatus’  and 
conducted  experiments:  Danial  Staines,  Reymundo  Ortiz,  and  Austin  Havens. 

Preparation  of  Liquid  Crystal  Cells 

We  have  built  eustom-designed  equipment  to  prepare  liquid  erystal  (LC)  eells 
for  experimentation  on  our  projeet.  LC  cells  consist  of  glass  plates,  eoated  with  a 
transparent  eondueting  layer  of  indium  tin  oxide  (ITO),  followed  by  a  rubbed-nylon 
alignment  layer,  with  a  ~4-12  pm  thiek  LC  layer  sandwiehed  between  plates.  This 
geometry  allows  us  to  observe  aligned  LC  materials  and  apply  eleetrie  fields  to  these 
samples  between  the  plates  (in  a  similar  fashion  to  a  parallel  plate  eapaeitor)  to 
measure  eleetro-optie  response.  To  aeeomplish  this  fabrieation,  students  built  the 
following  devices:  A  eustom-made  dip-eoater  applies  a  layer  of  nylon  to  glass-slides; 
a  rubbing  deviee,  whieh  rubs  the  nylon-eoated  eells  to  align  the  liquid  crystal 
molecules;  a  system  to  measure  cell  thickness  analyzes  interference  fringes  using  a 
spectrometer  on  an  unfilled  cell. 

Birefringence 

Measurements  of  the  birefringence.  An,  versus  temperature  have  been 
accomplished  on  two  “de  Vries’’-type  liquid  erystal  materials:  an  achiral  fluorinated 
compound,  8422,  and  a  siloxane  material,  TKSiKN65.  We  also  plan  to  examine  a 
chiral  homologue  of  8422,  8422[2F3].  The  results  of  these  measurements  showed 
behavior  that  is  consistent  with  Dr.  Saunders’s  predictions  from  his  previous  model 
(see  Fig.  1):  birefringence  increases  while  cooling  from  the  high-temperature  isotropic 


phase  in  the  SmA  phase,  but  near  the  transition  to  SmC,  the  birefringence  drops.  This 
indicates  increasing  orientational  order  when  cooling  high  in  the  SmA  phase, 
followed  by  an  unusual  decrease  in  orientational  order  near  the  transition.  In  the  SmC 
phase,  the  presence  of  arbitrarily-ordered  domains  makes  measurement  of 
birefringence  impossible  without  an  aligning  electric  field.  A  third  de  Vries  material, 
W415,  showed  completely  different  behavior:  the  birefringence  increased  almost 
linearly  with  cooling  throughout  the  SmA  and  SmC  phases.  This  behavior  was  not 
expected  in  a  de  Vries  liquid  crystal,  and  we  wish  to  investigate  this  material  further. 
However,  the  sample  we  obtained  has  chemically  degraded  which  has  limited  our 
present  inquiries:  we  hope  to  obtain  more  of  this  material  and  a  “standard”  smectic 
material  to  compare  with  our  other  de  Vries  materials  in  the  future. 
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Figure  1  Birefringence,  An,  versus  temperature  for  TsiKN65  (left)  and  8422  (right)  in  the  SmA  phase. 

While  our  data  supports  the  overall  trends  predicted  by  Dr.  Saunders’s  theory,  the 
precise  behavior  near  the  SmA-SmC  transition  may  indicate  whether  these  transitions 
are  near  the  tricritical  point  as  supported  by  Dr.  Barjami’s  data  below.  We  are 
implementing  an  interference  filter  and  a  photometric  calculation  from  our  camera 
system  to  obtain  more  precise  measurements  of  birefringence  for  these  and  other 
materials. 

Our  camera  system  supplied  by  this  grant  has  allowed  us  to  record  photo¬ 
micrographs  of  liquid  crystal  textures.  Figure  2  shows  the  material  8422  doped  with  5 
wt%  of  its  chiral  homologue,  8422[2F3],  in  the  SmA  (66°C)  and  SmC  (36°C)  phases. 
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Figure  2  8422  doped  with  5  wt%  of  its  chiral  homologue,  8422[2F3],  at  66°C  in  the  SmA  phase  (left) 
and  36°C  in  the  SmC  phase  (right). 


In  the  SmA  phase,  the  material  is  well-aligned  with  a  uniform  texture.  Upon  cooling 
into  the  SmC  phase,  the  molecular  director  (average  direction  of  the  long  axis  of 


molecules)  tilts  and  domains  with  different  orientations  are  observed  (see  Figure  2). 
An  electric  field  can  orient  the  domains  in  the  SmC  phase  along  one  orientation, 
producing  a  uniform  texture. 

Electro-optics 

The  SmC  phase  of  ehiral  liquid  crystals  is  ferroelectric:  a  spontaneous 
polarization  develops  that  is  coupled  to  the  orientation  of  the  molecular  director  (the 
average  long  axis  of  the  molecules).  We  have  applied  a  DC  electric  field  to  our 
samples  to  examine  the  effects  on  birefringence  and  molecular  orientation.  The 
material  8422  doped  with  5  wt%  of  8422[2F3]  was  switched  to  saturation  at  an 
extremely  low  field  of  ~1  V/pm:  this  extremely  high  susceptibility  is  a  hallmark  of  dc 
Vries  materials  that  is  particularly  impressive  considering  this  is  an  aehiral  material 
doped  with  only  a  small  amount  of  chiral  material.  Although  no  changes  were 
observed  with  an  applied  electric  field  high  in  the  SmA  phase,  near  the  SmA-SmC 
transition  we  observed  an  induced  tilt  within  ~3  °C  of  the  transition  and  small  changes 
in  the  birefringence  (see  Figure  3).  Our  present  measurements  of  birefringence  were 
insufficiently  sensitive  to  record  these  pretransitional  changes,  but  we  expect  that  our 
new  system  should  be  able  to  observe  these  field  effects.  Below  the  SmA-SmC 
transition,  the  birefringence  and  tilt  angle,  6,  increase  rapidly  and  appear  to  saturate  at 
~  37  ‘^C.  This  large  increase  in  birefringence  is  consistent  with  the  predictions  of  Dr. 
Saunders’s  theory. 
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Figure  3  8422  and  5  wt%  8422[2F3]  with  an  applied  field  of  5V/mm.  At  left,  the  birefringenee  vs. 
temperature  shows  the  pretransitional  drop,  followed  by  a  rapid  rise  in  the  SmC  phase.  Tilt  angle  (at 
right)  was  measured  to  be  zero  to  with  3  °C  of  the  transition,  and  in  the  SmC  phase  it  rapidly  inereases, 
saturating  at  6~  27°. 


After  implementation  of  our  new  birefringence  technique,  we  will  conduct  detailed 
measurements  of  8422  and  our  other  materials  with  a  DC  fields. 

We  applied  an  alternating  field  to  liquid  crystal  cells  to  investigate  the  time- 
dependent  nature  of  the  molecular  reorientation.  In  the  ferroeleetrie  SmC  phase,  an 
applied  field  reorients  molecules  and  switches  the  polarization-indueed  surface  charge 
from  one  side  of  the  cell  to  the  other.  This  produces  a  “polarization  current”  which 
can  be  measured  by  recording  the  current  flowing  through  the  cell  as  a  function  of  the 
applied  voltage.  We  built  a  circuit  to  measure  polarization  current  and  employed  a 
function  generator  producing  a  triangle  wave,  then  amplified  the  signal  to  produce  a 
90V  peak-to-peak  output.  An  oscilloscope  recorded  the  current  and  applied  voltage, 
shown  in  Figure  4  for  8422  doped  with  5  wt%  8422[2F3].  We  measured  peaks  in  the 


95%  8422  +  5%  8422[2F3];  4rC 


Figure  4  Current  vs.  time  through  a  cell  of  8422  and  5  wt%  8422[2F3]  with  an  applied  45V  triangle 
wave.  Two  peaks  are  observed  originating  from  the  switching  of  Ferroelectric  polarization  and 
induced  dielectric  polarization. 

current  due  to  ferroelectric  switching  (seen  only  in  the  ferroelectric  SmC  phase)  and 
dielectric  switching  (seen  throughout  the  smectic  phases).  The  rest  of  the  current 
signal  is  due  to  the  flow  of  ions  in  the  liquid  crystal  sample.  We  can  measure  the 
polarization  density  of  our  samples  by  integrating  the  polarization  current  of  our  AC 
signal.  We  are  developing  a  routine  to  compute  this  polarization  density,  and  we  will 
compare  our  results  in  the  vicinity  of  the  SmA-SmC  transition  to  the  predictions  of 
Dr.  Saunders’s  new  theory. 

Thermodynamic  Nature  of  A*-C*  Transition  (Dr  Barjami) 

A.  Building  and  operation  of  the  AC  Calorimeter  for  the  Order-Disorder 
Phenomena  Laboratory. 

Two  students  were  hired  beginning  Spring  quarter  and  Summer  quarter  in  the 
construction  and  testing  of  AC  Calorimeter.  A  block  diagram  of  the  design  and 
electronic  equipment  of  the  ac  calorimeter  that  was  built  from  scratch  and  will  be  used 
in  this  work  are  presented  in  Figures  5  and  6.  The  work  to  built  and  test  the  AC 
Calorimeter  extended  over  a  period  of  6  months,  from  March  2008,  till  August  2008, 
due  to  the  very  complex  nature  of  the  calorimeter. 
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Figure  5:  Schematics  of  the  AC  Calorimeter  build  in  our  Order-Disorder  Phenomena 
lab.  The  sample  lies  inside  a  massive  copper  block,  which  is  temperature  controlled  to 
better  than  \mK  in  the  stepwise  mode. 


Figure  6;  Block  diagram  of  Calorimeter  built  in  our  Order-Disorder  Phenomena  Lab., 
showing  all  the  connections  to  the  instruments.  The  whole  control  and  data 
acquisition  is  computer  controlled  through  a  GPIB  interface. 

Initial  Results  in  Testing  the  AC  Calorimeter. 

The  basics  of  the  AC  calorimetry  technique  consist  of  applying  periodically 
modulated  sinusoidal  power  to  the  material  to  be  studied,  and  monitoring  the  resulting 
sinusoidal  temperature  response  of  the  material.  After  sending  the  sinusoidal  power 
to  the  material  wc  monitored  the  temperature  response  oscillations  attached  to  the 
sample.  Such  oscillations  are  presented  in  Figure  7. 
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Figure  7:  Sinusoidal  response  of  AC  Calorimetry.  The  data  shown  represents 
the  raw  temperature  oscillations  in  the  sample,  without  any  averaging  or  smoothing 
routine  used,  which  highlights  the  very  high  -  resolution  capabilities  of  our 
calorimeter. 


Sinusoidal  response  of  the  sample  shown  in  Figure  7  is  a  direct  indicator  of  the 
successful  operation  of  the  new,  built  from  scratch  AC  Calorimeter  in  our  new  Order- 
Disorder  Phenomena  Laboratory,  which  we  employed  in  the  study  of  de  Vries  liquid 
crystals.  We  use  this  sinusoidal  response  of  the  sample  to  calculate  the  total  heat 
capacity  of  the  sample  and  cell,  given  by: 


ac 

where  Po  is  the  amplitude  of  the  applied  heating  power,  cb  is  the  angular  frequency,  C 
=Cs  +  Cc  is  the  total  heat  capacity  of  the  sample  and  cell,  and  Tac  is  the  amplitude  of 
the  temperature  oscillations. 

B.  Calorimetric  measurements  on  different  de  Vries  materials  to  correlate 
thermodynamic  nature  of  the  smectic  A-C  transition  with  the  size  of  the 
optical  response. 

A  new  class  of  chiral  smectics,  known  as  de  Vries  smectics,  shows  great  potential  for 
Ferroelectric  Liquid  Crystals  devices  as  they  exhibit  an  electroclinic  effect  with 
unusually  large  optical  responses,  with  little  or  no  layer  contraction.  The  application 
of  a  moderate  electric  field  (5  V/micron)  in  the  A*  phases  (5  V/micron)  yields  a 
rotation  of  the  optical  axis  of  up  to  3r  with  layer  contraction  of  less  than  1%! 
Another  attractive  feature  of  these  de  Vries  smectics  is  that  these  fast  and  colossal 
optical  responses  occur  over  a  relatively  wide  temperature  range.  Finally,  cooling  into 
the  C*  phase  shows  none  of  the  defects  and  loss  of  contrast  associated  with  layer 
contraction. 

Research  to  date  indicates  that  the  unique  and  desirable  features  of  de  Vries  materials 
are  directly  related  to  their  low  orientational  order  and  the  thermodynamic  nature  of 
the  A*-C*  transition,  which  will  be  the  goal  of  this  project. 

The  material  under  study:  TSiKN65  was  synthesized  by  J.  Naciri,  Center  for 
Bio/Molecular  Science  and  Engineering,  Naval  Research  Laboratory.  It  has  a 
significantly  large  electroclinic  effect  and  exhibits  a  small  layer  contraction  in  the  Sm- 
A  phase  even  when  a  large  electric  field  is  applied  across  the  cell,  as  well  as  from  Sm- 
A  to  Sm-C*  phase  in  the  absence  of  a  field.  Also,  the  order  parameter  is  indeed  found 
to  be  very  small  compared  to  that  obtained  for  conventional  Sm-^  or  Sm-C*  even 
when  a  large  electric  field  is  applied  across  the  cell,  and  is  not  well  understood 
because  no  detailed  direct  information  about  the  local  molecular  structure  has  so  far 
been  reported. 

In  order  to  determine  the  excess  heat  capacity  associated  with  the  phase  transition,  an 
appropriate  background  was  subtracted.  The  total  sample  heat  capacity  over  a  wide 
temperature  range  had  a  linear  background,  C/?(background),  subtracted  to  yield: 

ACp  =C^-Cp  [background ) 

as  the  excess  Cp  due  to  the  SmA-SmC  phase  transition.  The  resulting  ACp  data  are 
shown  for  pure  TSiKN65  in  Fig.  8  over  a  wide  temperature  range  about,  where  the 
units  are  J  K~'  per  gram. 


Figure  8:  Excess  specific  heat,  AQ?,  as  a  function  of  temperature  for  TSiKN65. 


A  very  sharp  Smeetie  A  to  Smeetie  C  phase  transition  peak  can  be  observed  in  Figure 
8  at  298.14  K.  To  eharaeterize  the  change  in  shape  of  the  ACp{SmA-SmC)  data,  a 

\T-r\ 

traditional  power-law  form  in  terms  of  the  reduced  temperature  t-  - — — — -  will  be 

used  to  analyze  the  experimental  specific  heat  data  associated  with  the  SmA-SmC 
phase  transition: 


ACp  {SmA-SmC)  =  A't  °  (l  +  D*/^' )  +  5, 

where  the  critical  behavior  as  a  function  of  reduced  temperature  t  is  characterized  by 
an  exponent  a,  amplitudes  A±  above  and  below  the  transition,  a  critical  background 
term  and  corrections-to-scaling  terms  characterized  by  the  coefficients  D±  and 
exponent  A,  □  0.5 .  Our  high-resolution  AQ?  ealorimetrie  data  indicates  that  the 

excess  heat  capacity  associated  with  the  Sm-A-Sm-C  transition  is  surprisingly  close  to 
a  trieritical  point.  The  evolution  toward  the  tricritical  point  observed  in  our  heat 
capacity  investigation  is  consistent  with  results  obtained  from  the  theoretical  study  of 
Dr.  Saunders. 


1)  Dr.  Karl  Saunders  Results: 


Theoretical  Model  (Dr  Saunders) 

The  theoretical  modeling  of  the  electroclinic  response  of  chiral  de  Vries  materials  has 
been  very  successful.  This  was  done  by  generalizing  a  zero-field  nonchiral  model  to 
include  the  effects  of  chirality  and  the  presence  of  an  electric  field.  A  manuscript 
describing  the  model  and  results  has  been  submitted  to  Physical  Review  E.  In 
particular,  the  model  predicts  the  following,  interrelated  features  of  de  Vries 
materials. 

1 )  Our  theoretical  model  indicates  that  materials  with  low  orientational  order  and 
strong  layering  order  should  exhibit  a  transition  close  to  a  tricritical  point.  This  is  a 
point  where  the  smectic-A*  -  smectic-C*  transition  goes  from  being  first  order  to 
second  order.  As  will  be  discussed  below,  the  proximity  to  such  a  transition  is  a 
crucial  factor  in  the  unusually  strong  electrooptic  response  of  de  Vries  materials.  The 
combination  of  low  orientational  order  and  strong  layering  order  is  significant 
because  many  de  Vries  materials  that  have  been  studied  to  date  do  indeed  exhibit  such 
a  combination.  The  theoretical  prediction  of  the  significance  of  this  combination 
could  help  in  the  design  and  synthesis  of  de  Vries  type  materials.  It  should  also  be 
pointed  out  that  a  preliminary  analysis  of  Dr  Barjami’s  calorimetric  data  indicates  that 
the  transition  in  TKSiKN65  is  indeed  close  to  a  tricritical  point.  Dr  Barjami’s  data 
also  has  some  other  unusual,  exciting  and  potentially  significant  features  that  we  plan 
to  analyze. 

2)  According  to  the  theoretical  model,  the  unusually  strong  electrooptic  response  of 
de  Vries  materials  can  be  attributed  to  the  proximity  of  their  smectic-A*  -  smectic-C* 
transition  to  a  tricritical  point.  As  discussed  above,  this  proximity  can  be  attributed  to 
a  combination  of  low  orientational  order  and  strong  layering  order.  For  de  Vries 
materials  with  a  second  order  transition  close  to  tricriticality,  the  electrooptic 
response,  i.e.  the  tilting  of  the  optical  axis  as  a  function  of  applied  field,  will  be 
continuous  but  unusually  strong.  For  a  first  order  transition,  the  effect  is  particularly 
striking,  with  the  electrooptic  response  being  discontinuous.  This  means  that  the 
tilting  of  the  optical  axis  will  exhibit  a  jump  as  applied  field  is  increased.  This 
unusually  strong  response  can  be  particularly  desirable  in  the  manufacture  of  liquid 
crystal  displays  (LCDs).  The  electrooptic  response  curves  predicted  by  the  theoretical 
model  are  qualitatively  consistent  with  published  data  on  de  Vries  materials. 

However,  we  are  excited  to  make  direct  quantitative  comparisons  with  electrooptic 
response  data  that  Dr  Femsler  plans  to  obtain  for  the  de  Vries  material  TKSiKN65. 

3)  An  exciting  prediction  of  the  theoretical  model  is  that  the  contraction  of  the  layers 
associated  with  the  strong  electrooptic  response  is  unusually  small  for  systems  with 
low  orientational  order,  of  which  de  Vries  materials  are  an  example.  The  combination 
of  strong  electrooptic  response  with  small  layer  contraction  is  highly  desirable  in  the 
LCD  industry.  This  is  because  it  avoids  buckling  of  the  layers  (observable  in  an 
optical  microscope  as  periodic  stripes)  which  drastically  reduces  the  performance 
necessary  for  optical  devices.  As  a  result  of  this  buckling,  the  only  commercial  FLC 
displays  are  used  in  camcorders  viewfinders  and  not  in  larger  displays,  such  as  in 
televisions  or  laptops.  Thus,  the  possibility  of  strong  electrooptic  response  without 
buckling  is  an  exciting  feature  of  de  Vries  materials.  The  theoretical  modeling  of  this 
project  has  gone  some  way  to  explaining  why  de  Vries  materials  exhibit  this  exciting 
feature. 


4)  A  final  result  of  our  theoretical  model  is  that  the  increase  in  the  birefringence 
associated  with  the  strong  electrooptic  response  is  unusually  large.  This  is  also 
important  in  the  context  of  de  Vries  type  materials  being  strong  candidates  for  use  in 
LCDs.  Again,  the  response  curves  (of  birefringence  to  applied  field)  predicted  by  the 
theoretical  model  are  qualitatively  consistent  with  published  data  on  dc  Vries 
materials.  We  also  look  forward  to  making  direct  quantitative  comparisons  with 
birefringence  data  that  Dr  Femsler  plans  to  obtain  for  the  de  Vries  material 
TKSiKN65. 


Remaining  tasks 

Optical  Response  and  Orientational  Order  (Dr  Fern  si er) 

Our  results  show  clear  support  of  Dr.  Saunders’s  de  Vries  model,  but  our 
present  measurement  accuracy  is  insufficient  to  extract  the  details  of  the  temperature- 
dependent  birefringence.  Application  of  our  new  interference  filter  and  revised 
method  for  determining  birefringence  should  allow  us  to  improve  out  measurements 
and  determine  the  nature  of  the  SmA-SmC  transition  in  orientational  order.  Using 
these  more  sensitive  results,  we  will  compare  the  results  of  our  three  dc  Vries 
materials  with  particular  interest  in  determining  whether  these  transitions  arc  near  the 
tricritical  point  indicated  by  Dr.  Barjami’s  results  and  Dr.  Saunders’s  theory.  We  also 
hope  to  obtain  more  of  the  material  W415,  which  showed  very  different  temperature- 
dependent  birefringent  behavior  and  a  “standard”  smectic  material  for  comparative 
purposes. 

Dr.  Saunders’s  new  theory  describes  electro-optic  interactions  in  the  vicinity 
of  the  SmA-SmC  transition.  We  observed  some  changes  in  the  birefringence  near  this 
transition,  but  with  our  improved  birefringence  measurements,  we  will  try  to  observe 
these  delicate  interactions  to  compare  with  the  theory. 

Thermodynamic  Nature  of  A  *-C*  Transition  (Dr  Barjami) 

The  assumption  of  SmA-SmC  tricritical  behavior  of  TKSiKN65  liquid  crystal  is  very 
powerful  and  requires  further  experimental  studies,  which  wc  propose  to  conclude 
during  Summer  2009.  Of  great  importance  is  the  calculation  of  latent  heat  of  the 
transition,  an  indicator  of  the  order  of  the  transition. 

However,  for  first-order  transitions  the  situation  is  complicated  by  the  presence  of  a 
two-phase  coexistence  region,  as  well  as  a  latent  heat  A//.  The  total  enthalpy  change 
through  a  first-order  transition  is  the  sum  of  the  pretransitional  enthalpy  and  the  latent 
heat.  In  an  y4C-calorimetric  measurement,  ACp  values  observed  in  the  two-phase 
region  are  artificially  high  and  frequency  dependent  due  to  partial  phase  conversion 
during  a  Tac  cycle.  The  pretransitional  enthalpy  dH  is  typically  obtained  by 
substituting  a  linearly  truncated  ACp  behavior  between  the  bounding  points  of  the 

two-phase  coexistence  region  into  5H  =  jAC^yr ,  while  an  independent  experiment 

is  required  to  determine  the  latent  heat  A//.  A  direct  integration  of  the  observed  AQ? 
yields  an  effective  transition  enthalpy  dH*  and  this  contains  some  of  the  latent  heat 
contributions;  thus  SH  <  SH*  <  AH,o,ai  =  SH  +AH. 


Theoretical  Model  (Dr  Saunders) 

The  main  remaining  task  with  regards  to  the  theoretical  modeling  is  to  cross-check 
our  theoretical  model  with  experimental  data  for  de  Vries  material  TKSiKN65.  This 
will  be  done  once  Dr  Femsler’s  has  completed  these  nontrivial  experimental 
measurements. 

As  discussed  above,  Dr  Barjami’s  data  indicates  that  the  smectic-A*  -  smectic-C* 
transition  in  de  Vries  material  TKSiKN65  does  indeed  take  place  near  a  tricritical 
point.  However,  the  material  shows  a  significant  pretransitional  anomaly  which 
indicates  that  the  transition  may  be  very  different  from  previously  observed  smectic- 
A*  -  smectic-C*  transitions.  There  may  be  a  connection  between  this  anomaly  and  the 
de  Vries-like  nature  of  the  material.  It  is  proposed  that  Dr  Saunders  carry  out  a 
theoretical  analysis  to  investigate  this  connection,  (see  below  under  New  ideas  and 
possibilities) 

New  ideas  and  possibilities 

Optical  Response  and  Orientational  Order  (Dr  Fernsler) 

The  structure  of  the  de  Vries  SmA  phase  is  still  unresolved  and  several 
conflicting  models  have  been  presented  to  the  research  community.  Observation  of 
samples  in  the  process  of  switching  may  help  determine  these  structures.  We  are 
particularly  interested  to  compare  the  anomalous  sample,  W415,  to  our  other  de  Vries 
materials  to  determine  if  this  material’s  different  temperature-dependent  birefringence 
is  also  reflected  in  a  different  switching  behavior.  We  have  developed  a  novel 
method  to  compute  the  orientation  of  the  molecular  director  during  application  of  AC 
electric  fields.  Our  camera  system  allows  us  to  record  a  movie  of  our  sample  in  the 
process  of  switching,  and  can  take  images  at  faster  than  standard  video  rates  for 
increased  resolution.  We  have  developed  a  simple  routine  using  Matlab  to  process 
image  data  from  these  movies  to  determine  the  average  brightness  of  the  cell  during 
switching.  The  intensity  of  the  signal  is  proportional  to  sin^  0,  where  ^is  the 
molecular  tilt  angle,  which  allows  us  to  extract  the  orientation.  Preliminary  data  of 
8422  with  5  wt%  8422[2F3]  switching  under  an  alternating  field  using  this 
photometric  approach  is  shown  in  Figure  9.  Furthermore,  statistics  on  the  orientation 
can  be  obtained  by  analyzing  the  image  data.  As  Dr.  Saunders  suggests  below, 
critical  fluctuations  may  be  important  in  the  nature  of  the  SmA-SmC  transition  of  de 
Vries  materials.  Our  statistical  analysis  of  images  during  switching  may  shed  light  on 
this  new  area  of  inquiry. 


8422:  AC  field 


time  (s) 

Figure  9  8422  with  5  wt%  8422[2F3]  image  intensity  versus  time  during  switching 
with  an  applied  sine  wave  with  50V  peak  to  peak. 

We  believe  that  this  new  technique,  combined  with  polarization  current 
measurements  may  help  us  resolve  the  structure  of  the  de  Vries  SmA  phase.  It  is  also 
possible  that  more  than  one  de  Vries  phase  exists:  e.g.  the  markedly  different 
temperature-dependent  birefringence  behavior  observed  in  W415  may  indicate  that  it 
has  significantly  different  structure  than  other  de  Vries  materials. 

Thermodynamic  Nature  of  A  *-C*  Transition  (Dr  Barjami) 

During  Summer  2009  we  propose  to  obtain  and  continue  the  study  of  deVries  liquid 
crystals  by  investigating  the  heat  capacity  behavior  of  other  deVries  liquid  crystals: 
W415  and  8422  and  comparing  the  results  with  heat  capacity  study  ofTKSiKN65  and 
with  the  results  obtained  for  the  Optical  Response  and  Orientational  Order  results 
obtained  by  Dr.  Femsler  on  these  materials. 

Theoretical  Model  (Dr  Saunders) 

The  pretransitional  anomaly  near  the  smectic-A*  -  smectic-C*  transition,  observed  by 
Dr  Barjami,  indicates  that  the  transition  may  be  very  different  from  previously 
observed  smectic-A*  -  smectic-C*  transitions.  Such  an  anomaly  often  means  that 
there  are  significant  critical  fluctuations  near  the  phase  transition.  We  propose  to 
investigate  the  size,  behavior  and  effects  of  critical  fluctuations  near  the  smectic  A*- 
C*  transition.  Such  an  investigation  has  never  been  carried  out  because  these  critical 
fluctuations  near  the  A*-C*  transition  have  always  been  assumed  to  be  negligible.  We 
believe  that  the  pretransitional  anomaly  observed  by  Dr  Barjami  may  be  evidence  that 
these  critical  fluctuations  can  in  fact  be  quite  significant  and  could  play  an  important 
role  in  underlying  mechanism  responsible  for  the  de  Vries  structure. 

Relevance/applicability  of  this  work  to  POD  interests 

Hand  held  electronic  devices  with  liquid  crystal  displays  (LCD’s)  arc 
ubiquitous  in  our  society  and  are  of  particular  interest  to  the  DOD  for  work  in  the 
field.  LCD’s  are  optimal  for  these  applications  because  of  their  slim  profile  and  low 
power  requirements.  Nevertheless,  significant  improvements  in  these  systems  can  be 
made  to  optimize  these  LCD’s  to  reduce  power  requirements  (which  can  lead  to 
longer  battery  life)  and  improve  visual  quality. 


Present  LCD’s  almost  all  use  the  twisted  nematic  geometry  where  alignment 
layers  between  the  two  plates  holding  the  liquid  crystal  material  are  oriented  90 
degrees  to  one  another.  This  produces  a  helical  twist  in  the  molecular  director,  which 
rotates  the  polarization  of  light  to  allow  linearly  polarized  light  to  pass  through 
crossed  polarizers  surrounding  the  cell.  To  achieve  a  dark  state,  these  twisted  nematic 
LCD’s  apply  an  electric  field,  which  polarizes  the  molecules,  which  then  rotate 
similar  to  dipoles  in  an  electric  field.  This  method  has  several  disadvantages  in  image 
quality.  Because  the  nematic  phase  itself  is  not  polar,  a  relatively  large  electric  field 
must  be  applied  to  polarize  and  reorient  molecules  and  this  reorientation  is  relatively 
slow.  Although  present  nematic  LCD’s  have  improved  this  response  time,  motion 
blurring  is  unavoidable  on  these  type  of  displays  because  bright  pixels  for  one  frame 
of  a  moving  image  stay  on  for  the  entire  duration  of  that  frame  and  then  switch  at  the 
beginning  of  the  next  frame:  our  eyes  blur  these  frames  together  causing  a  perceived 
distortion  in  moving  images.  Furthermore,  the  helical  structure  of  twisted  nematic 
LCD’s  causes  distortions  in  the  color  when  viewed  off-axis,  thereby  reducing  the 
viewing  angle  of  these  displays.  While  some  of  this  problem  has  been  corrected  by 
use  of  additional  refractive  films  coated  on  the  display,  this  adds  cost,  bulk  and 
reduces  some  light  coming  from  the  screen.  Finally,  because  the  nematic  phase 
inherently  produces  some  flicker  due  to  thermal  fluctuations  (observed  as  a 
shimmering  effect  in  a  polarizing  microscope)  and  the  electric  field  producing  the 
dark  state  of  a  pixel  cannot  fully  reorient  molecules,  the  contrast  ration  of  present 
LCD’s  is  limited  and  cannot  approach  that  of  a  traditional  cathode  ray  tube  (CRT) 
display. 

Smectic  liquid  crystals  could  improve  many  of  these  drawbacks  to  twisted 
nematic  displays.  The  chiral  SmC  phase  is  a  polar  ferroelectric  phase,  so 
reorientation  of  molecules  occurs  at  lower  applied  electric  fields  and  it  is  significantly 
faster  (by  about  an  order  of  magnitude).  This  can  allow  for  an  LCD  with  lower  power 
requirements  (hence  longer  battery  life)  and  can  eliminate  motion  blurring  by  using  a 
duty-cycle  approach  to  producing  a  grayscale  in  each  pixel  (the  amount  of  time  a 
pixel  is  bright  or  dark  during  each  frame  is  adjusted  to  produce  the  impression  of  dark 
or  light  pixel;  this  approach  is  used  by  digital  light  processing,  DLP,  projectors). 
Smectic  LCD’s  have  a  more  uniform  structure  thoughout  the  cell,  instead  of  the 
helical  structure  used  in  twisted  nematics,  which  would  improve  the  viewing  angle 
without  the  use  of  additional  films.  Finally  the  contrast  ratio  of  these  displays  would 
be  improved  over  nematic  displays  because  the  smectic  phase  does  not  suffer  from 
flickering  effects  and  has  a  more  uniform  structure  when  switched  with  electric  fields. 

Until  now,  smectic  liquid  crystals  have  not  been  used  extensively  in  displays, 
except  in  viewfinders  for  camcorders.  This  is  because  of  the  present  cost  of 
manufacturing  these  materials  and  defects  introduced  when  cooling  into  the 
ferroelectric  SmC  phase  due  to  a  contraction  of  the  smectic  layers.  De  Vries-type 
materials  can  eliminate  these  defects  because  of  their  lack  of  layer  contraction.  Up 
until  now,  only  a  relatively  small  number  of  de  Vries-type  materials  have  been 
synthesized  and  their  cost  is  prohibitively  high  for  use  in  displays.  However,  our 
work  to  understand  the  de  Vries  SmA  and  SmC  phases  could  lead  to  predictions  to 
improve  the  design  of  future  materials,  which  could  optimize  these  materials  for 
LCD’s  and  reduce  their  cost  by  simplifying  synthesis  and  producing  materials  in  bulk 
quantities. 
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Abstract 

Detecting  pedestrians  in  video  imagery  is  an  emerging  necessity  for  civil  and  federal  law 
enforcement  agencies,  and  agencies  within  the  Department  of  Defense.  Support  vector  machines 
(SVM),  neural  networks,  mixture  models,  and  boosting  algorithms  are  competing  methods  which 
have  all  been  suggested.  For  this  work,  we  focus  on  boosting  weak  classifiers  to  detect  pedestrians 
and  select  features.  Boosting  algorithms  are  attractive  because  they  rely  on  simple,  weak  classifiers 
and  they  are  computationally  inexpensive.  Furthermore,  they  serve  as  an  internal  method  of 
selecting  features.  We  have  already  implemented  a  fast,  accurate,  and  numerically  stable  boosting 
algorithm  for  detecting  pedestrians  and  selecting  features.  We  will  extend  our  current  research  and 
implement  a  mixture  model  weak  classifiers.  Also,  we  will  exploit  the  univariate  feature  selection 
already  present  to  allow  for  larger,  multivariate  feature  sets.  Furthermore,  continued  funding  will 
allow  us  to  better  continue  to  test  and  evaluate  our  newly  constructed  system.  This  project  will 
provide  continued  seed  money  for  the  principal  investigator's  professional  activities. 
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1  Identification  of  the  Problem 

Modem  surveillance  scenarios  are  saturated  with  digital  video  recorders,  autonomous  smart  weapons,  and 
sensing  platforms  that  contain  a  wide  variety  of  sophisticated  sensors.  As  such,  the  ability  to  automatically, 
accurately,  and  quickly  detect  objects  of  interest  is  a  capability  critical  to  the  mission  of  civilian  law 
enforcement  agencies.  Homeland  Security,  and  the  Department  of  Defense.  Rapid,  real-time  object  detection 
is  a  necessary  component  of  the  Navy's  mission  to  conduct  urban  warfare,  Automatic  Target 
Recognition  (ATR)  and  tracking  of  vehicles  of  interest,  and  "end  game"  delivery  of  autonomous  weapon 
systems.  The  research  we  propose  will  further  develop  the  theoretical  and  computational  methods 
needed  to  detect  objects  of  interest  captured  in  real-time  digital  video  imagery  as  well  as  a  wide  variety  of 
hyperspcctral  imagery. 

Current  \emph{  boosting}  algorithms  have  the  attractive  quality  of  providing  rapid  and  accurate  object 
detection,  and  they  rely  on  a  simple  threshold  weak  classifier  [I][9][l4][l5].  In  our  current  work,  wc  have 
implemented  a  quadratic  discriminant  weak  classifier  (as  we  proposed  in  our  previous  work).  Comparable  to 
current  boosting  methods,  we  use  only  a  single  feature  in  each  boosting  stage.  Mixture  models  have  already 
been  shown  to  improve  classification  in  comparison  to  a  single  quadratic  discriminant,  and  they  provide 
excellent  classification  results  [2][3][4][5][6].  Secondly,  our  current  implementation  relics  on  a  single  feature 
in  each  boosting  stage.  Classification  results  can  be  improved  by  internally  expanding  the  feature  sets  used. 

The  specific  object  detection  problem  we  consider  is  pedestrian  detection  in  video  imagery.  For  evaluation 
purposes,  we  will  continue  to  use  the  benchmark  data  set  DaimlerChrysler  Pedestrian  Classification 
Benchmark  Dataset  provided  by  DaimlerChrysler,  which  is  used  in  some  studies  [8][9][14][15].  The  data  set 
contains  thousands  of  images  which  either  have  or  do  not  have  a  pedestrian  present  in  each  image.  While 
most  implementations  rely  on  a  single  set  of  testing  and  training  data,  our  implementation  is  designed  as  a 
simulation  study  to  assess  performance  variability. 

2  Summary  of  Work 

Our  current  research  efforts  were  initiated  in  late  January,  2008.  The  funding  wc  received  was  less  than  the 
amount  we  requested.  As  a  result,  we  have  concentrated  our  efforts  on  the  computational  implementation 
which  we  proposed.  In  fact,  we  have  entirely  completed  the  proposed  work.  We  arc  pleased  to  report  that  wc 
have  successfully  implemented  a  stable,  accurate,  and  flexible  solution  in  Ch-h-.  Because  the  solution  is 
flexible,  wc  are  able  to  conduct  a  wide  range  of  simulation  experiments  using  any  set  of  data. 

A  large  component  of  the  current  research  is  the  C++  implementation  of  our  detection  algorithm.  We  have 
spent  a  considerable  amount  of  effort  developing  our  implementation  so  that  it  is  accurate,  reliable,  and 
flexible  allowing  for  different  experiments  and  simulation  studies.  Using  a  control  file,  we  arc  able  to  easily 
change  experiments,  data  sets,  and  algorithm  controls.  We  have  used  an  XML  schema  which  allows  for  the 
following  inputs. 

•  Training  Data:  specifies  the  complete  list  of  training 

•  Testing  Data:  specifics  the  complete  list  of  testing  data  and  associated  class  names.  To  be  clear,  the 
class  names  arc  not  used  for  learning  and  classification  purposes.  Rather,  we  use  the  class  names  for 
calculation  of  performance  metrics. 

•  Classifier  method:  specifies  the  classifier  method  to  be  used  cither  Threshold  or  Qda  for  the  linear 
and  quadratic  discriminants  respectively. 

•  Cascade  times:  specifics  the  number  of  boosting  stages  to  be  used. 

•  Simulation  count:  specifies  the  number  of  simulations  to  be  done.  If  simulation  count  is  set  at  I ,  then 
the  specified  set  of  training  and  testing  data  is  used.  If  the  simulation  count  is  larger  than  I ,  the  data 
is  combined  and  then  randomly  “broke”  into  training  and  testing  data  in  each  simulation. 
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•  Train  percent:  specifies  the  amount  of  data  that  should  be  used  for  training  purposes.  This  is  only 
used  when  we  run  multiple  simulation  experiments. 

The  implementation  also  uses  the  Matrix  package,  and  it  outputs  all  of  the  summary  metrics  to  portable 
Excel  file.  The  implementation  provides  the  backbone  for  future  work  in  the  area  of  Statistical 
Learning  Algorithms.  For  our  proposed  research,  we  will  continue  to  design,  implement,  and  test  more 
advanced  classification  and  feature  selection  methods. 

3  Results 

For  initial  testing  and  debugging  purposes,  we  simulated  a  set  of  data  from  Normal  distributions  which 
should  provide  good  classification  performance.  For  two  different  groups,  we  simulate  100  training  and 
testing  samples.  The  mean  vectors  are  given  below.  For  both  groups,  we  use  a  identity  matrix  as  the 
covariance  structure. 


Group 

Mean  Vector 

Pedestrian 

(-3, -2, -1,0,1) 

Non-Pedestrian 

(-3,-2,0,2,4) 

We  use  this  choice  of  mean  vectors  because  of  the  overlap.  It  should  be  clear  that  the  valuable  discrimination 
information  is  contained  in  the  last  3  elements  of  each  feature  vector.  Since  we  are  only  using  1  feature  in 
each  boosting  stage,  the  algorithm  should  use  and  select  the  last  3  features  for  classification  purposes.  An 
analysis  of  the  univariate  features  used  will  be  contained  in  future  a  publication  and  report.  In  this  simulation 
study,  we  use  25  boosting  stages,  with  50%  of  the  data  used  for  training,  and  50  different  simulations  to 
assess  the  performance  variability.  Primarily,  our  focus  is  to  compare  the  performance  of  the  linear  and 
quadratic  discriminants  we  have  chosen. 

In  figure  (1)  we  report  the  average  training  and  testing  error  rates,  and  the  performance  variability 
(specifically,  the  standard  deviation  of  the  classification  error  rate)  respectively.  For  the  linear  discriminant 
weak  classifier,  the  training  error  decreases  slightly  but  there  is  little  improvement  with  successive  boosting 
stages  in  the  testing  error. 
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Figure  2: 


Tlireshokl  Classifier:  Standard  Deviation 


Figure  (3)  summarizes  the  simulation  results  using  the  quadratic  discriminant  weak  classifier.  For  the 
quadratic  discriminant,  the  training  and  testing  error  decreases  with  more  boosting  stages  (albeit  the  decrease 
in  error  is  not  monotonic).  In  comparing  the  average  simulation  classification  error  for  the  quadratic  and 
linear  discriminants,  it  is  clear  that  the  quadratic  discriminant  has  lower  classification  error  than  the  linear 
discriminant.  The  improvement  is  more  noticeable  when  comparing  the  training  error  rates.  However,  our 
primary  concern  and  measure  of  comparison  is  the  testing  error  rates.  For  the  linear  discriminant,  there  is 
zero  improvement.  On  the  other  hand,  the  quadratic  discriminant  has  a  noticeable  decrease  in  the  testing 
error  rate. 
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Figure  3:  Qda  Cla.ssifier:  Average  Error  Rate 
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Figure  4:  Qda  Classifier: 


Standard  Deviation 


As  we  explain  in  the  proposal  for  the  current  funding,  boosting  algorithms  should  always  improve  the 
classification  performance.  However,  this  is  contingent  on  using  the  same  features  in  each  boosting  stage. 
Since  we  are  selecting  the  single,  best  feature  in  each  boosting  stage,  the  feature  set  is  not  constant  in  each 
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stage.  As  a  result,  we  are  not  guaranteed  a  monotonic  increase  in  classification  perfonnance.  For  the 
proposed  research,  wc  will  remedy  this  by  using  comparable,  growing  sets  of  features  in  each  feature  stage. 

A  novel  and  interesting  component  of  our  analysis,  here,  is  the  standard  deviation  of  the  classification  error 
in  Figures  (2)  and  (4).  Because  few  studies  fail  to  conduct  simulation  experiments  (ie  they  only  consider  a 
single  set  of  testing  and  training  data),  they  are  unable  to  provide  this  perspective  of  algorithm  perfonnance. 
In  fact,  wc  have  not  seen  such  results  reported  in  the  publicly  available  literature.  We  believe  this  simple  and 
useful  analysis  to  be  novel,  and  it  requires  more  attention.  A  priori,  we  anticipated  that  the  variation  would 
decrease  with  more  boosting  stages.  However,  this  is  not  the  situation.  In  most  experiments  with  the 
simulated  data,  the  variation  in  classification  error  actually  increases  throughout  the  boosting  stages.  It  is 
noteworthy  that  the  variation  is  much  less  for  the  quadratic  discriminant.  We  are  able  to  conclude  that  the 
quadratic  discriminant  provides  better  classification  results  with  less  variability  in  perfonnance. 
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Design  and  construction  of  a  magneto-optical  trap  for  experimental  investigation 
of  atomic  dipole  traps  for  quantum  computing 

Katharina  Gillen,  Physics  Department 

1.  Background  Information: 

The  goal  of  this  project  is  to  design  and  construct  a  magneto-optical  trap  in  order 
to  cool  a  sample  of  ®^Rb  atoms.  These  cold  atoms  will  then  be  used  to  explore  whether 
the  atomic  dipole  traps  formed  in  the  diffraction  pattern  behind  a  circular  aperture  are 
suitable  for  quantum  computing.  Quantum  computation  and  information  are  currently 
widely  investigated  fields  because  of  their  applications  in  communication  and 
decryption,  as  well  as  investigation  of  fundamental  quantum  physics.  One  of  the 
systems  identified  as  possible  quantum  computer  are  neutral  atoms  trapped  by  laser 
light.  The  remaining  difficulties  of  this  system  are  (1)  arranging  over  one  million  atoms  in 
a  way  that  still  allows  addressing  individual  atoms  for  quantum  computation,  and  (2) 
performing  two-qubit  gates,  which  require  bringing  pairs  of  atoms  together  and  apart 
controllably. 

In  my  previous  research  I  identified  the  diffraction  pattern  behind  a  simple  circular 
aperture  as  a  possible  atomic  light  (or  “dipole”)  trap.  Calculations  indicated  that  with 
modest  laser  power  (-100  mW)  atom  traps  appropriate  for  quantum  computation  can  be 
created.  Theoretically,  an  array  of  circular  apertures  would  then  also  yield  an  array  of 
such  atom  traps. 

With  the  help  of  previous  funding  through  the  C3RP  program,  we  were  able  to 
directly  measure  the  intensity  pattern  behind  a  commercial  pinhole  to  test  if  the 
diffraction  pattern  behind  a  real  pinhole  still  retains  all  the  features  necessary  for 
quantum  computing.  We  found  that  indeed  the  intensity  pattern  is  as  we  calculated.  The 
next  step  in  exploring  these  traps  is  to  trap  cold  atoms  in  them  and  measure  the  trap 
properties  by  observing  the  properties  of  the  trapped  atom  sample.  This  requires  pre¬ 
cooling  an  atom  sample  using  a  magneto-optical  trap  (MOT).  Design  and  construction 
of  a  MOT  is  the  goal  of  this  project. 

2.  Project  Plan: 

The  granted  C3RP  funding  was  used  to  design  and  construct  all  parts  of  a  MOT, 
which  is  needed  to  pre-cool  a  sample  of  ®^Rb  atoms  before  loading  them  into  the  new 
atomic  dipole  traps  described  above. 

The  MOT  system  consists  of  a  vacuum  chamber,  a  pair  of  electromagnets,  two 
tunable  diode  lasers,  and  an  optical  system  that  creates  six  laser  beams  of  appropriate 
polarization  in  order  to  slow  down  and  collect  atoms  (see  Fig.  1). 

In  order  to  trap  atoms  without  any  background  gases  expelling  them  from  the 
trap,  an  ultra-high  vacuum  environment  is  needed.  This  is  achieved  by  building  a 
vacuum  chamber  from  all  stainless  steel  and  glass  parts,  thoroughly  cleaning  all  parts  in 
a  multiple-step  process,  and  finally  “baking”  the  chamber  at  a  temperature  of  300°C 
while  pumping  it  out  with  a  turbomolecular  pump  backed  by  a  roughing  pump. 

Second,  a  pair  of  electromagnet  coils  is  needed  to  create  the  quadrupole 
magnetic  field  that  is  necessary  to  collect  the  atoms  into  a  small  cloud  at  the  center 
between  the  magnets. 
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Finally,  for  the  MOT  to  work,  two  tunable,  frequency-stabilized  diode  lasers  are 
needed.  The  lasers  are  split  into  six  beams  of  equal  intensity,  and  will  be  directed  into 
the  vacuum  chamber  such  that  two  opposing  beams  travel  along  each  of  the  three 
dimensions  of  space.  In  order  for  the  laser  beams  to  slow  the  atoms  and  collect  them  in 
the  center  of  the  vacuum  chamber,  the  laser  beams  have  to  be  circularly  polarized  and 
combined  with  the  quadrupole  magnetic  field  with  zero  field  at  the  center. 


Figure  1:  Magneto-optical  trap.  Six  laser  beams  and  a  quadrupole  magnetic  field  cool  down 
atoms  inside  a  vacuum  chamber.  (Picture  courtesy  of  the  Ohio  Supercomputing  Center.  The 
picture  is  a  screenshot  of  an  animation  of  a  MOT  previously  built  by  me.) 

Once  everything  is  constructed  and  aligned,  we  can  trap  atoms  in  the  MOT,  and 
characterize  the  properties  of  the  MOT.  The  number  of  trapped  atoms  can  be 
determined  by  measuring  the  amount  of  light  emitted  by  the  cold  atom  cloud  with  a 
photodiode.  The  temperature  of  the  atom  cloud  can  be  measured  by  measuring  the  size 
of  the  atom  cloud  with  a  CCD  camera.  We  can  use  this  information  to  optimize  the  MOT 
for  atom  number  and  temperature,  by  fine-adjusting  the  laser  alignment,  laser  frequency 
and  magnetic  field  strength. 

Future  work  after  building  the  MOT  will  be  to  load  the  cold  atom  sample  into  the 
dipole  traps.  This  will  require  a  carefully  timed  sequence  of  adjusting  the  laser 
frequencies  and  intensities  to  optimize  atom  transfer  to  the  dipole  traps.  After  that  we 
can  work  towards  demonstrating  quantum  computing  operations  on  the  trapped  atoms, 
such  as  initialization,  read-out  and  1 -qubit  gates. 

Funding  for  this  project  was  used  for  equipment  and  supplies,  and  student  and 
faculty  salaries  (added  compensation  and  summer  salary). 

3.  Student  involvement: 

All  aspects  of  this  research  project  involved  undergraduate  students.  During 
Spring  and  Summer  quarters  2008  a  total  of  five  students  worked  on  this  project:  Bert 
Copsey  (Mechanical  Engineering),  Angelica  Davidson  (Physics,  Spring  only),  Alison 
Goodsell  (Physics,  Spring  only),  Troy  Kuersten  (Physics  and  Aerospace  Engineering), 
and  Eric  Muckley  (Physics).  Details  of  the  students’  tasks  are  given  in  the  next  section. 
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4.  Tasks  completed: 

The  tasks  we  achieved  are: 

•  Acquire  equipment  (vacuum  parts,  ultrasonic  cleaner,  laser  power  supplies, 
Gaussmeters,  copper  wire  for  electromagnets,  optics) 

•  Improve  tunable  diode  lasers 

•  Set  up  frequency  stabilization  systems  for  diode  lasers 

•  Tune  diode  lasers  to  atomic  transition  frequencies 

•  Develop  and  perform  cleaning  procedure  for  ultra-high  vacuum  parts 

•  Design  and  construct  vacuum  chamber 

•  Design  and  construct  electromagnets 

•  Lay  out  optical  system 

•  Calculate  trapping  potentials  for  pairs  of  laser  beams  at  different  angles 
incident  on  a  pinhole 

Angie  Davidson,  assisted  by  Eric  Muckley  and  Alison  Goodsell,  constructed  two 
tunable  diode  lasers  for  use  in  the  MOT.  She  also  ordered/designed/built  all  parts  for  an 
additional  two  lasers  and  constructed  an  injection  locking  system  to  be  used  for  the 
experimental  realization  of  the  new  dipole  traps.  She  further  improved  the  laser  design 
by  installing  Brewster  windows  on  all  four  lasers. 

Alison  Goodsell  built  the  ultra-high  vacuum  (UHV)  chamber  needed  for  the  MOT. 
This  involved  4+  hour  baking  cycles  of  individual  parts  of  the  chamber  to  400  °C,  and  a 
thorough  4-step,  2-hour  cleaning  cycle,  and,  of  course,  the  assembly  of  the  chamber. 

Eric  Muckley  designed  and  built  a  pair  of  electromagnets  for  use  in  the  MOT. 
Because  of  the  strict  requirements  for  the  geometry  of  the  magnets,  we  had  to  custom- 
build  our  own  magnets.  Eric  designed  the  magnet  mounts  and  supports  and  developed 
a  method  for  winding  two  identical  magnets  without  “impurities.”  He  also  tuned  the 
tunable  diode  lasers  to  the  atomic  transition  frequencies  of  the  ®^Rb  atom  in  preparation 
for  trapping  atoms. 

Troy  Kuersten  designed  the  optical  layout  for  the  atom  trapping  experiment, 
which  involves  four  lasers,  the  MOT  vacuum  chamber  and  magnets  and  all  laser 
diagnosis  and  stabilization  setups  (three  vapor  locking  setups,  one  Fabry-Perot,  and 
one  saturated  absorption  setup).  Troy  also  built  and  tested  10  photodetectors  for  use  in 
the  various  parts  of  the  experiment. 

Bert  David  Copsey  designed  custom  mounts  for  the  vacuum  chamber  -  both  for 
during  the  bake-out  process,  and  for  day-to-day  operation.  He  also  put  together  and 
repaired  the  physics  department  vacuum  pumping  station  which  is  essential  in  the 
pumping  down  and  bake-out  process  of  the  UHV  vacuum  chamber.  At  the  end  of  the 
grant  period,  he  had  gotten  all  parts  to  work,  except  for  the  ionization  gauge.  Once  this 
is  replaced,  we  can  proceed  with  the  bake-out  of  the  UHV  chamber,  trap  atoms  at  ~200 
pK  from  absolute  zero  in  our  MOT,  measure  and  optimize  the  MOT  properties,  and 
then  use  the  cold  atoms  for  our  dipole  trap  experiments. 

In  addition,  during  various  delays  in  shipment  of  parts  for  the  pumping  station, 
Bert  continued  his  work  on  calculating  trapping  potentials  formed  by  laser  beams 
incident  on  a  pinhole  (using  a  Mathematica  code  that  he  developed).  In  particular,  he 
calculated  the  potential  that  atoms  in  specific  Zeeman  substates  experience  due  to  the 
intensity  pattern  formed  by  two  circularly  polarized  laser  beams  incident  on  a  pinhole  at 
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an  angle.  This  technique  may  provide  a  method  of  bringing  pairs  of  atoms  together  and 
apart  for  two-qubit  gates.  He  presented  preliminary  results  of  this  work  at  a  national 
conference  (see  below). 


5.  Results: 

We  successfully  constructed  all  necessary  parts  for  a  MOT  that  will  be  capable  of 
cooling  ®^Rb  atoms  to  -200  pK  from  absolute  zero:  (1)  Two  tunable  diode  lasers,  (2) 
two  electromagnets  for  the  magnetic  quadrupole  field,  and  (3)  an  ultra-high  vacuum 
chamber,  as  shown  in  Fig.  2. 


Figure  2:  MOT  setup,  (a)  Two  lasers,  (b)  MOT  magnets,  (c)  Vacuum  chamber,  (d)  Pumping 
station  (turbomolecular  pump  backed  by  roughing  pump). 


The  only  remaining  holdup  is  the  ionization  gauge  on  the  Physics  Department 
vacuum  pumping  station,  which  needs  to  be  replaced.  Once  it  is  replaced,  everything  is 
ready  for  baking  out  the  vacuum  chamber,  and  turning  on  the  MOT.  We  hope  to 
accomplish  this  by  June  2009. 

Our  computational  research  results  show  that  it  is  possible  to  use  two  circularly 
polarized  laser  beams  incident  on  a  pinhole  at  an  angle  to  trap  two  atoms  in  different 
Zeeman  substates  simultaneously.  Even  though  the  incident  angle  elongates  the  traps 
somewhat,  the  trap  properties  remain  comparable  to  those  of  a  laser  beam  at  normal 
incidence  (previously  described  in  Gillen  et  al..  Physical  Review  A  73,  2006,  013409). 
By  changing  the  angle  of  the  incident  laser  beams,  the  two  atoms  can  be  brought 
together  and  apart  controllably,  without  expelling  the  atoms  from  the  traps  (see  Fig.  3). 
This  can  be  used  to  facilitate  two-qubit  gates,  which  require  bringing  two  qubits  (here: 
atoms)  close  together.  This  would  constitute  tremendous  progress  towards  a  neutral 
atom  quantum  computer.  We  plan  to  investigate  this  computational  result 
experimentally  once  the  MOT  is  completed. 
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Figure  3:  (a)  Two  circularly  polarized  laser  beams  are  incident  on  a  circular  aperture  at  an  angle, 
(b)  Intensity  pattern  behind  the  aperture  that  traps  two  atoms  in  two  different  locations  (dark 
spots)  for  an  incident  angle  of  0.04  rad.  (c)  Intensity  pattern  behind  the  aperture  for  an  incident 
angle  of  0.02  rad.  By  reducing  the  tilt  angle  of  the  laser  beams  the  two  atoms  can  be  brought 
together  for  2-qubit  operations. 


6.  Presentation  of  results: 


The  computational  results  obtained  as  part  of  this  project  were  presented  by  Bert 
Copsey  (undergraduate  student)  at  the  American  Physical  Society’s  Division  of  Atomic, 
Molecular,  and  Optical  Physics  (DAMOP),  May  27-31, 2008,  at  Penn  State  -  a  national 
conference 


We  also  intend  to  prepare  these  and  future  results  for  publication  in  Physical 
Review  A. 

7.  Conclusions: 

We  successfully  designed  and  constructed  all  parts  of  a  magneto-optical  trap 
(MOT).  The  MOT  will  become  fully  operational  once  the  Physics  Department  pumping 
station  is  fully  fixed  and  the  vacuum  chamber  bake-out  is  performed.  Completion  is 
expected  by  June  2009. 

In  addition  to  the  experimental  work,  we  were  able  to  perform  computational  research 
on  atomic  dipole  traps  formed  behind  a  pinhole.  Preliminary  results  indicate  that  two 
circularly  polarized  laser  beams  incident  on  a  pinhole  at  an  angle  can  be  used  to  bring 
two  atoms  in  different  magnetic  substates  together  and  apart  without  expelling  ether 
atom  from  the  trap.  If  these  results  are  confirmed  by  experiments,  we  have  found  a  way 
to  facilitate  two-qubit  gates.  This  would  be  a  big  step  towards  building  a  neutral  atom 
quantum  computer. 
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Upgrading  a  fleet  of  GPS-tracked  ocean  surface  drifters  for  improved 
performance  and  extended  coverage  area 


Project  Investigator; 


Elizabeth  Griffith 
Department  of  Physics 
California  Polytechnic  State  University 
San  Luis  Obispo,  CA 
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Final  Project  Report  for  2007-2008  C3RP  Grant 

Submitted  by:  A.  Elizabeth  Griffith,  Physics  Department,  805-756-2473, 

aegriff1@calpoly.edu 

This  report  describes  our  progress  in  developing  a  fleet  of  GPS-tracked  ocean  drifters  to 
map  and  quantify  surface  currents.  Using  the  previous  grant  (2006-2007),  we  had  developed 
a  fleet  of  eight  ocean  drifters  to  map  ocean  surface  currents  within  10  miles  of  Avila  Bay,  and 
we  had  completed  one  test  run  of  the  drifters. 

This  year,  our  goals  were  to  (A)  extend  the  range  of  the  drifters  beyond  10  miles  from 
Avila  Bay  (B)  increase  the  battery  life  of  the  fleet  for  extended  use  (C)  improve  the  current¬ 
following  characteristics  of  the  drifters  (D)  make  the  investigations  safer  for  Cal  Poly 
participants  by  reducing  the  number  of  required  boat  trips  in  our  flat-bottom  boat 
(E)  enlarge  the  fleet  from  8  to  16  units  to  enable  more  extensive  current  mapping  capability, 
and  (F)  perform  trials  to  test  the  new  system  and  determine  the  feasibility  for  multiple 
deployments.  We  successfully  completed  all  but  the  last  goal.  We  have  started  trials  of  the 
new  drifter  fleet,  and  will  continue  the  trials  during  the  summer  of  2009. 

This  year  we  did  increase  the  tracking  range  of  our  system  from  10  miles  from  Avila  Bay 
to  extend  up  and  down  the  coast  of  north,  south  and  central  america  (see  Plate  1).  This  was 
accomplished  by  upgrading  the  drifter  electronics  to  SmartOnes,  sold  by  Fleet  Analytics. 


Last  updated  Septemter  2007 


Globalstar  Gateway 

Primary  Giobaistar  Service  Area 

Extended  Globalstar  Service  Area 

(Customem  may  eupcrtencc  a  weaker  sigrvai) 


Fringe  Globalstar  Service  Area 

(Customers  should  expect  to  expertervee  wt 


xpertervee  weakest  slignal) 


Globalstar  Service  Area  currently  unavailable  to  North  American  roamers 


Coveraise  may  vary  Map  denotes  coverajse  for  sateiMte  two-way  voice  arxd  duplex  data  only. 
Because  of  satellite  outages,  two-way  voice  and  duplex  data  Customers  may  experience  difficulty 
connecting  or  sustaining  ton^er  calls  at  certain  times  in  certain  specific  locations  through  2009 
A  Web-Oased  tool  to  identify  optimum  calling  times  Is  also  available  to  subscribers. 
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Plates  2  and  3  show  ocean  surface  currents,  measured  by  CODAR  (Moline,  et  al). 

Notice  that  on  the  days  shown  (June  21  and  26,  2009)  the  current  patterns  are 
significantly  different  from  one  another.  Specifically,  on  June  21  the  surface  currents  just 
south  of  the  Cal  Poly  pier  (indicated  by  a  red  dot)  are  headed  south,  away  from  the  pier. 
But  on  June  26,  the  surface  current  at  the  same  location  is  headed  north,  into  shore! 
Indeed,  the  nature  of  the  circulation  pattern  varies  depending  on  the  day,  time,  weather, 
surrounding  ocean  conditions,  ete. 

Plate  2.  Surface  Currents  from  CODAR  measurements.  (This  plot  and  the  next  were 
created  by  physics  major  Chris  Ferguson,  based  on  data  pulled  by  Brian  Zelenke.) 


Map  of  Surface  Currents,  June  21,  2009,  8  am  PST 
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Plate  3.  Surface  Currents  from  CODAR  measurements. 


Map  of  Surface  Currents,  June  26,  2009,  8  am  PST 


The  surface  velocity  maps  shown  in  Plates  2  and  3  are  useful  to  understand  the  general 
character  of  the  surface  currents  along  the  central  coast  of  California.  But  this  type  of 
map  does  not  answer  these  questions: 

•  How  long  does  it  take  for  water  to  travel  from  Avila  Bay  to  Point  Sal? 

•  At  what  rate  would  a  contaminant  introduced  in  Avila  Bay  disperse  into  the 
surrounding  water? 

•  What  is  the  residence  time  of  ocean  water  in  Avila  Bay? 

These  are  difficult  questions,  but  they  can  be  readily  answered  through  the  use  of  ocean 
drifters  with  GPS  tracking,  and  subsequent  analysis  techniques. 

Our  plan  is  to  first  use  the  drifters  to  quantify  local  coastal  recirculating  currents  that  are 
difficult  to  predict.  After  about  six  local  runs  of  the  fleet  this  summer  and  early  fall  (to 
quantify  recirculating  currents),  we  plan  to  apply  for  local  funding  to  pay  for  charter  boat 
use  to  deploy  our  drifters  further  from  shore  to  explore  the  California  Current  as  well  as 
typcial  currents  from  nearby  marine  sanctuaries. 
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Plate  4.  Undergraduate  physics  majors  (Galen  Cauble  and  Tom  Baker)  assemble  the 
drifters  on  the  pier  deck,  conduct  stability  tests  and  set  up  overnight  leak  tests  to  cheek 
the  drifter  performance. 


( 
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We  performed  a  trial  run  of  four  of  our  new  ocean  drifters,  by  deploying  them  just  south 
of  the  Point  San  Luis  breakwater  in  Avila  Bay.  The  starting  and  ending  locations  are 
shown  on  the  map  below.  (The  red  dot  indicates  the  Cal  Poly  pier.)  Unfortunately  there 
was  an  error  that  prevented  the  communication  of  the  GPS  systems  during  the  majority  of 
this  particular  test.  This  error  has  now  been  remedied,  so  that  complete  drifter  tracks  will 
be  obtained  in  future  runs.  The  starting  and  ending  point  locations  (below)  suggest  that 
in  this  case  the  ocean  carried  the  drifters  in  a  rather  simple  track  toward  the  southeast. 

And  in  this  case  we  learned  that  the  currents  swept  the  drifters  to  Oceano  Dunes  in  a 
period  as  short  as  30  hours  for  the  first  drifter,  and  as  much  as  42  hours  for  the  last 
drifter. 

Plate  5.  Starting  and  ending  locations  of  drifters.  July  30  -  August  1,  2009. 

The  starting  locations  are  above  in  the  plot  (north),  near  the  legend  and  the  ending 
locations  are  south-east  of  the  initial  positions.  The  red  dot  is  the  location  of  the  Cal  Poly 
pier  facility. 
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Plates  6a  and  6b.  Surface  velocity  maps  of  currents  near  Avila  Bay,  based  on  CODAR 
data.  The  drifters  were  deployed  at  about  1 1  am  on  July  30,  2009.  The  first  plot  shows 
currents  on  the  day  the  drifters  were  deployed.  The  second  plot  shows  currents  the 
following  day  when  two  drifters  washed  up  on  Oceano  Dunes  beach.  This  plot  was 
rendered  by  physics  major  Chris  Ferguson. 


Currents,  July  30  2009,  3  PM  PST 
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Currents.  July  31  2009,  3  PM  PST 


Longitude  (Degrees) 


Plate  7.  Wind  direction  during  the  July  30  -  August  1 ,  2009  drifter  run. 
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Plate  8.  Wind  speed  during  the  July  30  -  August  1,  2009  drifter  run. 

Beginning  Thursday  Jul  30,  2009  11:36  AM 
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As  mentioned  on  the  first  page,  there  were  six  major  goals  of  our  project  this  year.  Here 
is  a  summary  of  the  outcomes: 

A.  We  successfully  extended  the  range  of  the  drifters.  Last  year,  the  tracking  range 
was  limited  to  10  miles  from  Avila  Bay.  Now  we  can  receive  data  (via  satellite) 
from  up  and  down  the  west  coast  -  from  Alaska,  south  america,  and  even  a  large 
portion  of  the  Pacific  Ocean.  This  was  achieved  by  upgrading  the  electronics, 
then  redesigning  the  drifters  (including  the  ballast,  top  and  bottom  rings,  etc)  to 
accommodate  the  new  equipment. 

B.  Wc  increased  the  battery  life  of  the  fleet  from  12  hours  to  14  months.  This  will 
allow  prolonged  data  collection  to  quantify  larger-scale  ocean  surface  currents. 

C.  Wc  improved  the  capability  of  the  drifters  to  more  accurately  follow  the  ocean 
water,  and  be  less  influenced  by  the  wind.  This  was  done  by  increasing  the  so- 
called  drag  area  ratio,  which  is  equal  to  the  cross-sectional  area  of  the  drifter  that 
is  exposed  to  the  flow  of  water  divided  by  the  cross-sectional  area  that  is  exposed 
to  the  flow  of  wind.  Wc  more  than  doubled  this  ratio,  so  that  our  new  drag  area 
ratio  of  slightly  greater  than  40  is  as  good  as  ocean  drifters  being  used  in  the  SVP 
(Surface  Velocity  Program),  ARGOS  program,  etc. 

D.  We  made  the  investigations  safer  for  Cal  Poly  participants  by  eliminating  the  need 
for  boat  pick-up  of  the  drifters.  Our  new  method  is  to  wait  for  the  drifters  to  wash 
up  on  shore,  while  wc  track  and  plot  their  locations  on  web-based  software. 

E.  Wc  enlarged  the  fleet  from  8  to  16  units  to  enable  more  extensive  ocean  surface 
current  mapping. 

F.  Wc  conducted  trials  of  the  new  system  and  found  that  the  approach  with  the  new 
electronics  is  feasible  for  future  deployments  and  oceanographic  studies.  We  will 
continue  these  trials  and  initial  data  collection  during  the  summer  of  2009. 
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Data  analysis: 

In  his  senior  thesis  to  support  this  project,  undergraduate  physics  major  Tom  Baker 
practiced  using  analysis  tools  for  the  ocean  drifter  data.  For  example,  he  practiced 
interpolating  a  velocity  field  based  on  a  simulated ocQZXi  drifter  track.  The  method  that 
oceanographers  use  to  interpolate  and  extrapolate  their  ocean  drifter  data  from  irregularly 
spaced  points  onto  a  fully  resolved  and  regular  grid  is  called  Kriging.  We  used  the 
Kriging  software  developed  by  Woods  Hole  Oceanographic  (called  EasyKrig  3.0)  to 
accomplish  this. 

Plate  9.  Analysis  practice:  Kriged  data  from  a  simulated  drifter  track.  (T.  Baker,  2009) 


Test  Data  Set  1  (kriged) 


Longitude 


Following  the  analysis  approaches  of  modem  oceanographers,  we  will  use  the  drifter 
data  to  create  vector  maps,  or  “snapshots”  of  the  surface  currents  around  Avila  Bay,  and 
maps  of  mean  and  eddy  kinetic  energy  along  the  coast.  This  will  help  us  to  understand 
the  evolution  of  the  ocean  flow  (ie  the  flow  of  energy  from  large  scales  to  small  scales) 
including  its  turbulent  stmcture.  We  will  also  calculate  an  important  transport  statistic  - 
the  residence  time  of  ocean  water  in  Avila  Bay  and  at  other  locations  along  the  coast. 
And  we  will  estimate  the  rate  of  dispersion  at  these  locations.  One  example  of  how  these 
quantities  are  useful  is  that  they  help  biologists  quanify  the  living  environment  of 
organisms  in  the  ocean  such  as  phytoplankton  and  fish.  By  analyzing  the  flow  with 
respect  to  various  parameters  (wind,  tides,  bathymetery,  etc)  we  will  contribute  to  the 
more  accurate  prediction  of  coastal  flows  as  a  function  of  environmental  variables. 


157 


N00014-07-1-1152 


P.l. Susan  C.  Opava,  Ph.D. 


Shock  and  Vibration  Hardened  Data  Acquisition  Device 


Project  Investigator: 


Garrett  Hall 

Department  of  Civil  and  Environmental  Engineering 
California  Polytechnic  State  University 
San  Luis  Obispo,  CA 
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Shock  and  Vibration  Hardened 
Data  Acquisition  Device 


1  Introduction 

The  intent  of  this  report  is  to  outline  the  preliminary  design  of  a  hardened 
case  intended  to  protect  and  isolate  a  data  acquisition  system  (DAS).  The 
primary  concern  is  the  survivability  of  the  device  with  respect  to  potential 
external  conditions,  specifically  shock  and  vibration.  The  modeling  approach 
consisted  of  the  following  tasks. 

•  Model  DAS  Specification:  The  example  DAS  used  in  this  study  was 
provided  by  Ron  Meritt  of  kleritt  International.  A  hardware  specimen 
was  delivered  as  an  example  of  a  data  acquisition  system  that  would 
require  hardening  in  order  to  survive  shocks  of  the  type  possible  in  a 
mobile  security  surveillance  scenario. 

•  Performance  Specifications:  Appropriate  integrity  standards  were 
adopted  for  the  design  of  the  hardening  system.  The  inputs  included 
shock/ vibration  specifications  appropriate  for  the  in-situ  conditions  an¬ 
ticipated  by  the  DAS  application. 

•  Material  specification:  Through  mechanical  design  appropriate  ma¬ 
terials  were  determined  for  the  DAS  hardening.  Alloys,  composites, 
and  hybrid  materials  were  considered  along  with  the  economic  aspects 
of  each. 

•  Geometry:  Based  on  the  design  constraints  determine  an  appropriate 
geometric  configuration  for  the  DAS  hardening  system.  In  addition  to 
geometric  constraints  consideration  was  also  given  to  ease  of  fabrica¬ 
tion. 
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•  Numerical  modeling:  A  numerical  model  of  the  combined  DAS  and 
hardening  system  was  develoi)ed  whth  the  intent  of  utilizing  the  mnner- 
ical  model  to  hell)  guide  the  design,  fal)rieation.  and  i)rodnction  i)hases. 
Numerical  studies  of  the  preliminary  design  included: 

Fi’equency  analysis:  The  natural  frequencies  of  the  couil)iued 
DAS/liardening  system  were  estimated  through  a  numerical  finite 
element  model. 

—  PSD  simulation:  A  power  spectral  density  analysis  of  the  sys¬ 
tem  was  performed  based  on  well  known  integrity  testing  protocols 
{e.(j.  M1L-STD-810E  minimimi  integrity  test).  Virtual  tests  were 
run  in  three  orthogonal  directions  to  determine  the  anticipated 
efiects  and  sensitivity  to  the  PSD  load  as  measured  at  the  DAS. 

—  Blast  simulation:  Numerical  time  history  analyses  wen'  con¬ 
ducted  to  simulate  performance  during  a  typical  blast  event.  The 
simnlatioiis  provide  a  (pialitative  measure  of  the  system  integrity. 

-  Thermal  analysis:  Thermal  loads  created  by  the  DAS  were  con¬ 
sidered  with  respect  to  the  hardening  system  to  evaluate  the  jx)- 
tential  for  overheating  caused  by  the  hardening  enclosure. 

The  remainder  of  the  report  summarizes  outcomes  from  the  above 
tasks. 


2  Model  DAS  Specification 

Figures  1  through  5  below'  provide  an  overview  of  the  DAS  i)rovided  by 
Meritt  International  .  The  first  three  jjhotographs  show'  the  exterior  of  the 
case  with  the  hard  drive  carrier  removed.  The  last  tw’o  i)hotographs  show 
the  hard  drive  carrier  from  top  and  bottom  views.  Note  that  the  hard  drive 
tray  itself  is  isolated  from  the  carrier  by  four  black  bushings. 
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Figure  1:  Top  view  of  Meritt  DAS 


Figure  2:  Front  view  of  Meritt  DAS 
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Figure  3:  Rear  view  of  Meritt  DAS 


Figure  4:  Top  \uew  of  Meritt  DAS  internal  hard  dri\’e 
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Figure  5;  Bottom  view  of  Meritt  DAS  internal  hard  drive  carrier 

All  dimensions  and  material  specifications  for  the  DAS  in  the  subsequent 
sections  were  based  on  the  hardware  provided  by  Meritt  International.  Note 
however,  that  the  design  approach  and  hardening  device  is  easily  modified 
for  alternative  data  acquisition  systems. 

3  Performance  and  Testing  Specifications 

The  recommended  testing  protocols  and  guidelines  potentially  applicable  to 
the  present  design  with  respect  to  shock  and  vibration  include: 

•  Vibration:  MIL-STD  810F  Method  514 

•  Shock:  MIL-STD  810F  Method  516 

•  Pyroshock:  MIL-STD  810F  Method  517 

•  Ballistic  shock:  MIL-STD  810F  Method  522 

The  above  listed  guides  all  emphasize  the  need  for  tailoring  any  and  all 
experimental  validation  to  the  specific  environmental  conditions  present  or 
potentially  expected  over  the  life  of  the  component.  In  addition  there  may 
be  other  applicable  guidelines  depending  on  the  specifics  of  the  DAS.  For 
example  electromagnetic  interference  testing  may  refer  to  MIL-STD  461 F 
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for  guidance.  In  this  rej^ort  only  shock,  vibration,  and  operational  thermal 
loads  were  considered  as  described  next. 

4  Numerical  Modeling 

The  design  was  arrived  at  through  an  iterative  series  of  numerical  simulations 
which  considered  the  eigenvalues,  psd  response,  and  blast  event  response  of 
the  system  under  design.  In  addition  a  thermal  analysis  of  the  system  was 
conducted  to  estimate  the  interior  temperature  of  the  system.  The  following 
four  sections  j)rovide  a  brief  overview  of  the  numerical  simulations  conducted 
on  the  j)reliminary  design (s).  The  basic  conceptual  design  is  given  in  the 
figure  below. 


^ - DAS  hardening  enclosure 

^  thermally  conductive  foam  layer 

DAS  IkkIv  (carrici  ) 


DAS  mechanically  isolated  electronics 


Figure  6:  Conceptual  design. 


4.1  Eigenvalue  Analysis 

The  natural  frecpiencies  of  the  DAS  were  calculated  for  each  design  as  a 
measure  of  the  intrinsic  dynamic  properties  in  the  system.  The  table  below 
lists  the  frequencies  and  their  source  (i.e.  if  the  predominate  contribution 
is  in  the  case  or  in  the  interior  equipment).  Following  the  table  graphical 
representations  of  the  mode  shapes  (eigenvectors)  is  provided  in  Figures  7 
through  l.'l. 
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Mode 

Frequency  (Hz) 

Predominate  Part 

1 

102.55 

Hard  Drive 

2 

102.85 

Hard  Drive 

3 

105.43 

Hard  Drive 

4 

184.69 

Hard  Drive 

5 

188.36 

Hard  Drive 

6 

196.17 

Hard  Drive 

7 

732.73 

Hardening  Case 

8 

746.77 

Hardening  Case 

9 

793.55 

Hard  Drive 

10 

836.2 

Hardening  Case 

11 

994.08 

Hardening  Case 

12 

1037.3 

Hardening  Case 

13 

1091.8 

Hard  Drive 

14 

1294.5 

Hardening  Case 

15 

1379.5 

Hard  Drive 

16 

1414.2 

Hardening  Case 

Figure  7:  Eigenmode  for  the  7'^  eigenvalue. 
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Hgiin'  8:  Eigeiiniode  for  the  8'^  eigenvalue. 


Figure  9:  Eigenmode  for  the  10'^  eigenvalue. 
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Figure  10;  Eigenmode  for  the  eigenvalue. 


Figure  11:  Eigenmode  for  the  12‘^  eigenvalue. 
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F'igure  12:  Eigeiim()(l('  for  the  14'^’  eigenvalue. 

I 


Figure  13:  Eigenuiode  for  the  16'^  eigenvalue. 
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4.2  PSD  Assessment 

A  PSD  analysis  was  run  based  on  the  military  specification  MIL-STD-810F 
(see  Figure  14  below  for  an  example  PSD  curve).  Figure  15  indicates  that 
the  displacement  response  is  dominated  by  the  isolation  on  the  hard  drive. 


Figure  14;  Example  PSD  specification. 


Figure  15:  PSD  displacement  response  curve. 
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4.3  Blast  Simulation 

This  section  siiiniiiarizcs  the  results  of  a  simulated  blast  events  acting  on  tlu' 
hardeiK'd  system.  The  blast  jirofile  was  a  simplified  enveloi)ing  form  derived 
from  experimental  data  on  flat  j^latcs,  see  Figure  IG.  The  i)eak  pressure  used 
ill  the  sininlation  is  apiiroximatelv  equivalent  to  0.25  kg  of  Pentolite  tleto- 
nated  at  50  crn  from  the  hardened  device  [1].  Material  jirojierties  are  industry 
standard  values  as  listixl  herein.  Note  that  for  steel  a  dynamie  increase  factor 
has  been  applied  to  the  yield  stress  {e.g.  see  [5]  and  the  reh'renci's  therein). 

The  disjilaeeinent  resjionse  of  the  jirotected  hard  drive  as  a  function  of 
time  is  reported  for  each  of  the  threi'  blast  profiles  (toj).  side,  and  front) 
ill  Figures  17-19  resjieetively.  Note  that  the  magnitude  of  the  disjilaeement 
in  each  event  ar<'  of  the  same  ordi'r  of  magnitude.  Consistent  with  the  low 
displacement  magnitudes,  the  accelerations  an'  high,  though  the  final  values 
will  depend  upon  the  jiarticnlar  form  of  isolation  acting  between  the  carrier 
and  the  hard  drive  itself.  In  the  present  sininlation  a  rubber  isolation  bushing 
system  was  assumed. 
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Figure  17:  Average  displacement  magnitude  of  the  hard  drive,  top  blast 
event. 


Figure  18:  Average  displacement  magnitude  of  the  hard  drive,  side  blast 
event. 
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IWTW.  Me 


Figure  19:  Average  (lisi)laeeiuent  magnitude  of  the  hard  drive,  front  blast 
ewnt . 

4.4  Thermal  Analysis 

The  study  suininarized  below  examined  the  thermal  performance  of  the  sys¬ 
tem  in  a  preliminary  manner.  The  analysis  considers  heat  conduction  and 
surface  heat  convection  for  lower  and  ui)per  bounds  estimates  to  the  thermal 
load  on  the  interior  of  the  DAS.  The  upper  bound  assumes  50.6  Watts  and 
tin*  lower  bound  3.40  Watts. 

Materials  The  hardening  enclosure  design  considered  various  j)otential 
materials  in  the  preliminary  stages.  The  final  materials  settled  uimii  con¬ 
sisted  of  a  steel  enclosure  body,  thermally  conductive  foam  interface  material, 
fire  resistant  O-ring  gasket,  and  an  Amphenol  type  harness  connector. 

Geometry  and  Boundary  Conditions  The  only  part  of  the  enclosure 
considered  in  contact  with  an  external  sink  was  the  four  regions  imuK'diately 
snrrounding  the  bolt  hold  down  locations.  The  exterior  of  the  enclosure  was 
allowed  to  convect  to  still  air  at  the  same  temperature  as  the  sink  (75  Fahren¬ 
heit).  The  interior  was  loaded  with  the  aforementioned  heat  generation  from 
the  electronics.  Note  that  all  of  these  modeling  assumptions  would  have  to 
be  tailored  to  a  specific  ajijdication  to  verify  adequacy  of  the  thermal  design. 
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The  present  analysis  answers  the  question  of  feasibility  with  regard  to  the 
DAS  enclosure  design. 

Results  The  nodal  temperatures  and  heat  flux  for  the  two  load  cases  are 
shown  below.  The  results  are  provided  at  steady  state  conditions.  It  is 
noted  that  depending  upon  the  electronics  considered,  the  upper  bound  heat 
generation  is  unfavorable  whereas  the  lower  end  is  reasonable. 


Figure  20;  The  temperature  distribution,  in  Fahrenheit,  for  the  50.6  watt 
case. 
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NTll 


07.7719 

06.7024 

05.6329 

84.5634 

03.4940 

82.4245 

01.3550 

80.2055 

79.2160 

70.1466 

77.0771 

76.0076 

74.9381 


Figure  21:  The  temperature  distribution,  in  Fahrenheit,  for  the  3.40  watt 


case. 


HFL,  Hagnltud« 
SNEG,  (friction 
(Avg;  75\) 

10.1691 
0.1550 
0.1409 
0.1268 
0.1127 
0.0906 
0  0845 
0.6704 
6  6564 
6.6423 
6.6202 
6.6141 
■-  6.0606 


Figure  22;  The  lieat  Hiix  for  the  50.6  watt  case. 
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HFL,  Magnitude 
SNEG,  (fraction  : 
(Avg:  75\) 
e.eii3 
9.9193 
9.999A 

9.9965 
9.9975 

9.9966 
9.9956 
9.9947 
9  9936 
9.9926 
9.9919 
9.9999 


Figure  23:  The  heat  flux  for  the  3.40  watt  case. 


5  Summary  of  the  Mechanical  Design 

Based  on  the  simulated  prototype  process,  the  mechanical  design  is  expected 
to  perform  adequately  for  the  performance  specifications  of  Section  3.  This 
section  provides  an  overview  of  the  mechanical  design.  The  solid  model  and 
summarial  drawing  files  are  shown  in  Figures  29  through  29. 
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Figure  24:  Solid  model  of  DAS  body 
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Figure  25;  Solid  model  of  DAS  cover 
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Figure  26:  Solid  model  of  DAS  design 
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Figure  27:  Overview  of  DAS  design 
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F"igure  28;  DAS  cover  design 
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Figure  29;  DAS  body  design 
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Abstract 

Physiological  adaptations  in  a  microgravity  environment  for  astronauts  during  space 
flight  arc  common.  One  such  adaptation,  bone  loss  and  the  subsequent  decrease  in  skeletal 
strength,  has  been  recognized  as  a  potential  problem.  Exereise  during  spaee  missions  has  not 
been  effective  in  overeoming  bone  loss.  Bisphosphonates  have  been  used  suecessfully  to 
inerease  bone  mass  in  osteoporosis  patients  and  offer  a  possible  solution  to  eounter  bone  loss  in  a 
mierogravity  setting.  They  work  direetly  on  osteoclast  activity  to  suppress  bone  resorption  and 
increase  bone  mass.  A  consequence  of  their  aetions,  though,  is  reduced  bone  turnover  leading  to 
an  increase  in  the  brittleness  of  bone.  The  goal  of  the  proposed  research  was  to  develop 
computational  models  to  examine  the  effeets  of  bisphosphonate  therapy  (1)  on  preserving  bone 
mass  during  spaee  flight  and  (2)  on  the  fraeture  risk  of  bone  for  the  subsequent  return  to  an 
environment  with  gravity.  A  previously  developed  remodeling  simulation  was  modified  to 
aeeount  for  bone  loss  due  to  weightlessness  and  then  the  effects  on  bone  mass  of  various 
bisphosphonate  therapy  sehedules  with  drugs  of  different  potencies  were  studied.  In  addition, 
the  effects  of  the  length  of  treatment  on  subsequent  fracture  risk  upon  returning  to  Earth  were 
examined.  These  models  developed  in  this  study  will  have  a  wide  variety  of  orthopaedic 
applications,  including  examining  the  effects  on  bone  integrity  and  fracture  risk  of  other 
pharmaeeutieals  to  eounter  bone  loss  (such  as  parathyroid  hormone  or  osteoprotegerin  therapy), 
exercise  training  programs,  age,  bone  diseases  and  their  treatment,  and  orthopaedie  implant 
designs. 

Background 

Bone  loss  has  long  been  recognized  as  a  potential  problem  for  individuals  involved  in 
spaee  flight.  The  effects  of  mierogravity  result  in  several  physiologieal  ehanges  for  astronauts, 
ineluding  the  adaptation  of  bone  to  the  weightless  environment  of  spaee  whieh  results  in  the 
activation  of  the  bone  remodeling  process  to  remove  bone  insuffieiently  stressed.  For  longer 
term  flights,  a  reported  92%  of  astronauts  experienced  at  least  5%  loss  of  bone  at  one  skeletal 
site  while  40%  experienced  at  least  a  10%  bone  loss  (LeBlanc  et  al.,  2007).  In  general,  bone 
mineral  density  changes  in  the  spine  and  femur  have  resulted  in  deereases  of  0.7%  to  2.7%  per 
month  in  spaee  despite  the  participation  of  crewmembers  in  exereise  regimes  designed  to  combat 
the  loss  of  bone  during  the  mission.  In  addition,  on  returning  to  Earth  following  spaee  flight, 
these  adaptations  ean  manifest  themselves  into  physical  impairments  necessitating  a  period  of 
rehabilitation  that  may  result  in  the  permanent  loss  of  bone  mineral  density  and  an  increased  risk 
for  fracture  (Lang  et  al.,  2006;  Payne  et  al.,  2007). 

Bone  loss  in  a  mierogravity  environment  is  caused  by  increased  bone  remodeling,  a  two- 
stage  proeess  earried  out  by  teams  of  cells  known  as  basic  multicellular  units  (BMUs). 
Resorption  of  a  paeket  of  bone  by  osteoclasts  is  followed  by  refilling  of  the  resorption  cavity  by 
osteoblasts.  In  humans,  this  sequence  typically  requires  3-4  months  to  complete  at  each  site,  and 
the  resorption  eavitics,  while  individually  small,  may  collectively  add  substantial  porosity  to 
bone.  Not  only  is  remodeling  the  biological  process  for  bone  turnover,  but  it  also  is  believed  that 
remodeling  acts  as  the  mechanism  for  bone  to  adapt  to  its  mechanical  environment  and  to 
remove  microdamage  due  to  relatively  high,  cyclic  skeletal  loads  so  as  to  improve  fatigue 
resistance.  In  support  of  these  beliefs,  there  is  strong  experimental  evidence  that  remodeling  is 
activated  (1)  to  remove  bone  that  is  insufficiently  loaded  (due  to  weightlessness,  immobilization. 
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stress  shielding  by  implants,  etc.)  and  (2)  by  fatigue  microdamage.  Li  et  al.  (1990)  demonstrated 
significant  and  rapid  bone  loss  as  a  result  of  increased  resorption  compared  to  bone  formation  in 
studies  where  limbs  were  immobilized,  signifying  a  rapid  remodeling  response  to  bone  in  disuse. 
Alternatively,  Burr  and  coworkers  showed  that  in  vivo  fatigue  loading  of  cortical  bone  to 
physiologic  strains  produces  damage  in  the  form  of  microcracks  and  activates  remodeling  in 
spatial  proximity  to  them  (Burr  et  al.,  1985;  Mori  and  Burr,  1993).  Subsequently,  Bentolila  et  al. 
(1998)  demonstrated  a  similar  phenomenon  in  the  ulnae  of  rats,  which  normally  do  not  remodel 
their  cortical  bone,  suggesting  that  remodeling  in  response  to  nearby  microdamage  is  a 
fundamental  biological  response. 

Exercise  has  frequently  been  used  to  counter  bone  loss  in  a  microgravity  environment. 
Exercises  during  space  flight  involving  resistance  training,  bicycling,  and  treadmill  activity  have 
been  effective  to  varying  degrees  for  several  physiological  systems,  but  have  not  been  effective 
at  preventing  the  loss  of  bone  (LeBlanc  et  al.,  2007).  Bisphosphonates  are  drugs  developed  to 
treat  bone  diseases  involving  excessive  remodeling,  such  as  osteoporosis.  With  their  ability  to 
suppress  bone  resorption  and  increase  bone  mass,  bisphosphonates,  either  alone  or  in 
combination  with  an  exercise  program,  offer  tremendous  potential  for  maintaining  bone  during 
space  flight,  even  for  periods  of  long  duration  in  a  weightless  environment.  Bisphosphonates 
have  a  high  affinity  for  bone  mineral  and  are  incorporated  into  bone  at  sites  where  remodeling 
has  exposed  hydroxyapatite  (Rogers  et  al.,  1997).  They  subsequently  assert  their  anti-resorptive 
effect  upon  contact  with  osteoclasts  (Lin,  1996).  Different  bisphosphonates  exhibit  wide 
variability  in  their  ability  to  suppress  osteoclastic  activity.  Those  with  high  potency  (>  lOOx  that 
of  etidronate,  a  first  generation  drug)  can  suppress  resorption  at  a  relatively  low  dose,  thus 
avoiding  another  biological  effect  of  bisphosphonates,  the  physicochemical  impairment  of 
mineralization  (Fleisch,  1998).  The  resulting  tissue-level  mechanisms  for  bisphosphonate- 
mediated  increases  in  bone  mass  include  reduced  remodeling  space  (the  temporary  porosity  due 
to  remodeling)  and  a  positive  bone  balance  (less  bone  removed  than  replenished  at  individual 
remodeling  sites).  Suppression  of  bone  resorption  by  bisphosphonates  may  involve  cellular 
mechanisms  that  are  direct,  such  as  disruption  of  osteoclast  differentiation,  or  indirect,  such  as 
increasing  inhibitory  signals  from  cells  of  the  osteoblast  lineage  (Breuil,  1999).  Other 
possibilities  include  shortening  the  lifespan  of  osteoclasts  by  inducing  apoptosis  (Rodan,  1998), 
and  decreasing  their  resorbing  efficiency  by  altering  the  cytoskeleton  (Rodan  and  Fleisch,  1 996). 
Currently,  the  dominant  mechanisms  are  not  clear,  but  presumably  they  may  vary  with  the 
chemical  structure  of  the  particular  bisphosphonate. 

There  are  abundant  data  on  the  positive  effects  of  bisphosphonate  treatment  to  increase 
bone  mass  in  osteoporotic  patients.  Liberman  et  al.  (1995)  found  that  3  years  of  alendronate 
treatment  increased  spinal  bone  mineral  density  (BMD)  8.8%  and  reduced  vertebral  fractures  by 
48%  relative  to  controls.  Tonino  et  al.  (2000)  reported  that  postmenopausal  women's  spinal 
BMD  increased  throughout  7  years  of  alendronate  treatment.  However,  reduced  bone  turnover 
increases  mean  skeletal  age  and  the  degree  of  mineralization  of  existing  bone  (Boivin  et  al., 
2000;  Rodan  and  Fleisch,  1996),  and  this  may  contribute  to  microdamage  accumulation  by 
slowing  its  removal  and  making  the  bone  tissue  more  brittle.  In  dogs,  both  alendronate  and 
risedronate  treatment  for  one  year  resulted  in  microdamage  accumulation  that  was  inversely 
correlated  with  BMU  activation  frequency  (Mashiba  et  al.,  2001).  While  the  latter  data  are  from 
dogs  treated  at  dosages  exceeding  human  clinical  levels,  they  also  represent  relatively  brief 
treatment  periods.  Therefore,  there  is  concern  that  bisphosphonates  of  high  potency  may,  in  the 
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long-term,  lose  their  ability  to  reduce  fracture  risk  as  microdamage  accumulates  and  negates  the 
benefits  of  increased  bone  quantity  by  decreasing  bone  quality. 

Computational  models  are  useful  for  studying  bone  remodeling  and  the  effects  of 
bisphosphonates  on  bone.  For  this  study,  a  previously  developed  computational  model  for  bone 
remodeling  (Hazelwood  ct  al.,  2001)  was  modified  to  study  the  effects  of  bisphosphonate 
therapy  on  preserving  bone  mass  in  a  microgravity  setting  during  space  flight  and  on  the  fracture 
risk  of  bone  for  the  subsequent  return  to  an  environment  with  gravity.  This  model  incorporates 
the  effects  of  the  mechanical  environment  of  bone  and  microdamage  on  remodeling,  and  tracks 
the  effects  of  bisphosphonate  treatment  on  bone  volume  fraction,  activation  frequency,  and 
microdamage. 


Fig.  I.  Bone  remodeling  algorithm  for  the  Fig.  2.  Representative  volume  of  hone, 

computational  models. 


Computer  Model  Development 
Remodeling  Simulation 

This  study  utilized  a  modified  version  of  previously  developed  computational  models  for 
bone  remodeling  in  response  to  mechanical  and  biological  influences  (Hazelwood  et  al.,  2001, 
Nyman  et  al.,  2004).  These  bone  adaptation  models  incorporate  the  coordinated  responses  of 
BMUs  (or  basic  multicellular  units,  the  teams  of  bone  cells  that  resorb  and  form  bone)  to  two 
mechanical  stimuli  known  to  initiate  remodeling:  disuse  and  fatigue  damage  (Fig.  1).  The 
model  tracks  the  interactive  changes  in  remodeling,  strain,  and  fatigue  microdamage  that  occur 
in  a  representative  volume  of  bone  (Fig.  2)  when  the  equilibrium  of  such  a  system  is  disturbed. 
In  this  model,  an  empirical  relationship  was  used  to  relate  the  continuum  level  elastic  modulus  to 
bone  volume  fraction.  Changes  to  bone  volume  fraction  (the  volume  of  bone  normalized  by  total 
volume  including  void  spaces)  in  the  model  were  functions  of  the  temporal  and  geometric 
characteristics  of  bone  remodeling.  Damage  and  disuse  were  quantified  in  terms  of  the 
mechanical  stimulus  function,  O  =  Rl  x  developed  by  Carter  et  al.  (1987),  where  Rl  is  the 
number  of  cycles  that  the  strain  s  is  applied.  Fatigue  microdamage  and  bone  remodeling  were 
characterized  in  terms  of  histomorphometric  variables.  The  microdamage  formation  rate  was 
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assumed  to  be  proportional  to  the  mechanical  stimulus  O.  The  rate  of  damage  removal  was  a 
function  of  the  current  amount  of  damage,  the  BMU  activation  frequency,  and  the  area  resorbed 
by  BMUs.  BMU  activation  frequency  was  calculated  daily  from  the  amount  of  disuse  and 
existing  damage.  The  numbers  of  resorbing  and  refilling  BMUs  active  each  day  were  calculated 
from  the  activation  frequency  history  over  the  remodeling  period:  25  days  for  resorption,  5  days 
for  reversal,  and  64  days  for  refilling.  Daily  bone  volume  fraction  (BVF)  changes  were  then 
calculated  from  the  net  amount  of  bone  removed  or  added  by  each  resorbing  or  refilling  BMU, 
respectively.  A  mechanism  was  included  to  allow  for  less  than  complete  refilling  on  trabecular 
surfaces  in  disuse. 

Simulation  of  Preflight  Conditions 

Before  applying  microgravitational  conditions,  preflight  parameters  were  calculated 
using  constants  derived  from  experimental  data.  The  applied  stress  on  Earth  to  reach  these 
experimental  values  was  determined  by  matching  the  predicted  bone  volume  fraction  for  the 
model  to  0.22,  or  equivalently  a  density  of  0.44  g/cm^,  a  density  typical  of  vertebral  trabecular 
bone  in  adult  males  in  Earth’s  gravitational  environment,  assuming  a  linear  relationship  between 
bone  volume  fraction  and  bone  density.  The  calculated  applied  stress,  1  MPa,  was  based  on  a 
100  mm^  cross-section  from  the  representative  trabecular  bone  volume  (Fig.  2). 

Simulation  of  Spaceflight 

Microgravity  was  simulated  by  lowering  the  stress  applied  to  the  bone  volume. 
Astronauts  experience  an  average  vertebral  trabecular  BMD  loss  of  0.7%  per  month,  for  a  total 
of  4.2%  BMD  loss  during  the  180  day  average  ISS  missions  (Iwamoto  et  al.,  2005;  Lang  et  al., 
2004;  LeBlanc  et  al.,  2007).  For  this  simulation,  stress  applied  to  the  representative  volume 
during  spaceflight  was  then  determined  as  0.8909  MPa  based  on  this  180  day  spaceflight  ending 
density  of  0.42 1 5  g/cm^. 

Using  the  density  loss  values  at  180  days  as  a  baseline,  various  durations  of  spaceflight 
were  simulated  based  on  typical  mission  length  for  astronauts,  including  10  days,  90  days,  and 
180  days.  Although  365  days  in  space  is  not  typical,  it  was  also  simulated  to  examine  the 
potential  of  bisphosphonates  to  maintain  BMD  without  increasing  bone  microdamage. 

Simulation  of  Bisphosphonate  Treatment 

Bisphosphonate  treatment  was  simulated  using  two  factors:  a  decrease  in  the  activation 
frequency  and  a  reduction  in  the  resorption  area.  A  potency  variable  (P),  where  0  <  P  <  1 ,  was 
applied  to  exert  the  former  effect  by  multiplying  the  activation  frequency  of  BMUs  by  the 
quantity  (1  -  P).  The  potency  variable  P  was  based  on  pharmacokinetic  properties  of 
bisphosphonates,  including  potency  factors,  binding,  uptake,  and  mode  of  action, 
P  =  Pmax(l  -  e  where  Pmax  and  x  are  suppression  coefficients  reflecting  various 

properties  of  bisphosphonates  in  order  to  model  a  range  of  drug  potencies.  Values  for  these 
coefficients  were  selected  based  on  the  experimental  results  from  1  year  studies  of  daily 
alendronate  and  daily  pamidronate  treatment,  and  modeled  the  variations  in  the  reduction  of 
BMU  activation  frequency  as  seen  in  these  studies. 
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The  size  of  the  resorption  eavity  is  redueed  during  bisphosphonate  treatment  due  to  their 
effeets  on  osteoelasts  (Nyman  et  al.,  2004),  resulting  in  alterations  to  the  ratio  of  bone  area 
formed  to  bone  area  removed.  Two  different  initial  bone  balanee  ratios  {AfIAr)  for  the  simulation 
of  bisphosphonate  treatment  were  used  based  on  reduetions  of  1/6  and  3/13  to  resorption  area 
found  in  postmenopausal  women  treated  with  bisphosphonates  for  1  year  (Nyman  et  al.,  2004). 
A  bone  balanee  of  1 .0  was  assumed  for  the  simulation  when  bisphosphonate  treatment  was  not  in 
effeet. 

Bisphosphonates  were  simulated  during  the  entire  spaeeflight.  Preflight  treatment  was 
also  examined,  where  bisphosphonates  were  applied  to  the  simulation  at  0,  7,  14,  30,  90,  and  180 
days  preflight. 

Simulation  of  Return  to  Earth 


The  return  to  earth  was  modeled  by  resuming  preflight  bone  loading  eonditions,  with  an 
applied  stress  of  1  MPa  to  the  representative  bone  volume.  Onee  baek  on  Earth,  bisphosphonate 
therapy  was  diseontinued.  The  simulation  was  extended  365  days  postflight  to  examine  inereases 
or  deereases  in  fraeture  risk  based  on  bone  mineral  density  and  damage  accumulation.  Although 
it  takes  1  to  3  years  to  fully  reeover  without  treatment,  a  one  year  postflight  examination  allowed 
us  to  determine  if  a  treatment  was  sueeessful  at  maintaining  bone  mass  without  aeeumulating 
more  damage. 

Model  Results 

Spaeeflight  Without  Bisphosphonate  Treatment 

Model  results  without  bisphosphonate  treatment  were  eonsistent  with  experimental  data 
obtained  from  spaceflight  (Bloomfield,  2006).  Bone  mineral  density  (BMD)  and  mierodamage 
deereased  from  preflight  levels  due  to  the  redueed  loads  in  a  mierogravity  environment  of 
spaceflight  without  bisphosphonate  treatment  (Figs.  3,  4,  and  5).  The  predieted  rate  of  BMD  loss 
was  greatest  early  in  the  flight,  showing  smaller  ineremental  loses  as  time  spent  in  spaee 
inereased.  The  model  predieted  a  marginal  change  in  BMD  from  preflight  eonditions  for  the 
typieal  flight  duration  of  10  days;  however,  postflight  predietions  showed  that  BMD  eontinued  to 
deerease  upon  return  to  Earth  until  it  reaehed  a  value  nearly  3  times  lower  than  at  the  end  of  the 
mission  before  inereasing  to  near  normal  levels  about  100  days  after  entering  Earth’s  gravity. 


to  90  180 

Duration  of  flight  (days) 


Fig.  3.  Predicted  percent  decreases  m  BMD 
and  damage  at  the  end  of  spaceflight  withont 
bisphosphonate  treatment. 


1 88 


NOOOl  4-07- 1-1 152 


P.l. Susan  C.  Opava,  Ph.D. 


For  the  180  day  space  mission,  the  predicted  postflight  results  for  bone  without 
bisphosphonate  treatment  showed  sharp  increases  in  both  BMD  and  damage  upon  returning  to 
Earth  (Figs.  4  and  5).  BMD  stabilized  approximately  7  years  postflight,  and  was  about  2.7%  less 
than  its  preflight  value.  Damage  continued  to  accumulate  postflight  until  about  1 5  years  after  the 
return  to  Earth.  Although  damage  was  initially  lower  upon  the  return  to  Earth,  it  continued  to 
increase  postflight  for  approximately  15  years  until  reaching  a  value  approximately  9.5%  higher 
than  its  preflight  value. 

Spaceflight  With  Bisphosphonate  Treatment 

While  BMD  during  a  1 80  day  spaceflight  was  maintained  at  or  increased  above  preflight 
levels  with  bisphosphonate  treatment  of  low  and  high  potency  given  at  the  onset  of  spaceflight, 
respectively,  damage  levels  also  increased  above  the  baseline  values  for  the  high  potency  drug 
(Figs.  4  and  5).  Following  the  return  to  the  gravitational  environment  of  Earth,  BMD  for  the 
high  potency  bisphosphonate  decreased  as  remodeling  activation  increased  to  counteract  the 
higher  level  of  damage.  For  the  low  potency  drug  given  at  the  onset  of  spaceflight,  postflight 
BMD  increased  above  preflight  conditions  due  to  the  increased  loading  upon  returning  to  Earth 
while  damage  remained  below  the  preflight  level  (Figs.  4  and  5). 

Results  were  similar  but  not  as  pronounced  for  the  10  and  90  day  spaceflights.  For  these 
shorter  flight  durations,  high  suppression  of  BMU  activation  led  to  increases  in  both  BMD  and 
damage  accumulation  during  flight.  Postflight  results  suggest  that  damage  remains  elevated 
while  BMD  decreases  for  shorter  flights  with  high  potency  drugs.  Simulated  bisphosphonate 
treatment  at  the  beginning  of  spaceflight  with  the  low  potency  drug  produced  decreases  in  both 
BMD  and  damage  during  the  flight  for  the  10  and  90  day  spaceflights.  For  the  shorter 
simulations  with  the  low  potency  drug,  postflight  BMD  increased  above  preflight  conditions  and 
damage  remained  below  preflight  values.  Simulation  of  the  longer  365  day  space  mission  had  a 
more  pronounced  effect  than  the  180  day  mission,  with  decreases  in  damage  predicted  to  be 
14.5%  during  the  mission,  while  BMD  exhibited  only  slight  changes,  for  the  low  potency  drug 
given  at  the  onset  of  the  mission.  For  the  high  potency  drug,  increases  in  damage  during  the  365 
day  mission  reached  7.5%  while  the  increase  in  BMD  was  2.3%  with  bisphosphonate  treatment. 


Fig.  4.  Simulated  effects  of  spaceflight  and 
bisphosphonate  therapy  on  BMD  during  a 
180  day  space  mission  (beginning  at  time 
t=0)  and  for  365  days  following  the  return  to 
Earth. 


Fig.  5.  Simulated  effects  of  spaceflight  and 
bisphosphonate  therapy  on  microdamage 
during  a  180  day  space  mission  (beginning 
at  time  t=0)  and  for  365  days  following  the 
return  to  Earth. 
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Postflight  results  for  the  365  day  space  mission  predieted  decreases  in  BMD  (and  elevated 
amounts  of  damage)  upon  returning  to  the  gravitational  environment  of  Earth  for  the  high 
potency  bisphosphonate  treatment  while  results  for  the  low  potency  drug  show  an  increase  in 
BMD  (and  decreased  damage)  compared  to  preflight  values  after  returning  to  Earth. 

When  giving  bisphosphonate  therapy  prior  to  spaceflight,  increasing  predicted  preflight 
gains  in  BMD  and  damage  were  observed  as  the  duration  of  the  simulated  preflight  therapy 
increased  from  7  to  180  days.  For  longer  durations  in  space,  the  model  predicted  these  preflight 
therapy  periods  to  be  less  effective  at  influencing  the  end-of-flight  results  for  BMD  and  damage. 
As  the  duration  in  space  increased,  the  model  predicted  the  end-of-flight  values  to  be  influenced 
more  by  the  effects  of  spaceflight  than  the  effects  of  preflight  therapy.  Alternately,  preflight 
bisphosphonate  therapy  highly  influenced  the  model’s  predictions  of  BMD  and  damage  for 
shorter  durations  of  spaceflight.  For  the  bisphosphonate  potencies  simulated,  the  addition  of 
preflight  treatment  caused  increased  BMD  and  damage  accumulation  at  the  end  of  10  day 
spaceflight.  For  the  90  day  spaceflight,  a  preflight  therapy  period  of  30  days  resulted  in 
increases  in  BMD  without  significantly  increasing  damage,  and  the  same  occurred  with  a  90  day 
preflight  treatment  period  prior  to  the  180  day  spaceflight. 

Conclusions 

The  eomputer  model  developed  here  combines  previous  bone  remodeling  and 
bisphosphonate  algorithms  plus  spaeeflight  data  obtained  from  experimental  studies  in  literature 
in  order  to  better  understand  the  adverse  effects  of  microgravity  on  bone  and  fracture  risk.  The 
model  prediets  redueed  risk  of  fraeture  by  inereasing  bone  quantity  and  either  increasing  or 
maintaining  bone  quality  for  bisphosphonate  treatments  (1)  with  low  suppression  of  remodeling 
activation  and  (2)  that  create  higher  bone  balance  ratios.  The  simulation  also  prediets  signifieant 
changes  to  BMD  and  damage  upon  returning  to  Earth  as  the  remodeling  response  readjusts  to  the 
higher  stress  conditions.  For  treatments  highly  suppressing  remodeling  activation,  these 
predicted  postflight  changes  include  decreased  BMD  and  increased  damage  accumulation.  Low 
levels  of  remodeling  suppression  led  the  model  to  predict  substantial  increases  in  BMD  and 
small  increases  in  damage  postflight. 

The  model  was  developed  to  match  the  4.2%  loss  in  BMD  over  180  days  in  space  as  seen 
on  the  International  Spaee  Station  (ISS).  The  model’s  largest  predicted  BMD  loss  in  untreated, 
trabecular  vertebral  bone  was  5.01%  for  a  365  day  spaceflight.  This  is  less  than  half  the  highest 
loss  (10.8%)  seen  in  Russian  eosmonauts  on  Salyut  missions  lasting  5  to  7  months  (LeBlane  et 
al.,  2007).  Although  the  model  docs  not  match  the  results  from  these  older  missions,  it  is  likely 
due  to  advancements  in  teehnology,  physical  preparedness  of  the  subjeets,  and  onboard  exercise 
routines  that  were  developed  for  missions  on  the  International  Space  Station. 

Full  recovery  for  space  explorers  returning  from  the  ISS  took  from  1  to  3  years  to 
complete  (LeBlane  et  al.,  2007).  The  model  developed  here  predicted  that  full  recovery  to 
preflight  BMD  values  may  never  be  attained  without  treatment.  With  bisphosphonate  treatment, 
the  model  predieted  eomplete  rceovery  to  oceur;  some  treatments  even  resulted  in  higher  BMD 
values  than  existed  preflight.  The  model  suggests  that  bisphosphonate  treatment,  combined  with 
exercise,  may  be  the  solution  that  space  exploration  programs  desire  to  combat  bone 
deterioration  in  space. 

The  predicted  remodeling  response  of  untreated  bone  to  environmental  changes  was  non¬ 
linear,  as  most  BMD  was  lost  or  gained  early  in  the  transitions  from  Earth  to  spaee  and  from 
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space  back  to  Earth.  For  10  days  in  space,  the  model  predicted  more  bone  density  to  be  lost 
while  readjusting  to  Earth’s  gravity  than  lost  during  spaceflight.  This  has  yet  to  be  examined 
experimentally,  but  certainly  the  model  provides  insight  into  a  possible  trend  that  may  have  gone 
unnoticed.  The  model  predicts  bisphosphonate  treatment  to  be  beneficial  for  all  durations  of 
spaceflight,  not  just  for  longer  duration  missions.  In  many  instances,  preflight  treatments  were 
shown  to  reduce  the  fracture  risk  upon  return  to  Earth.  Longer  simulated  flight  durations  required 
longer  preflight  treatments  to  provide  similar  effects  to  those  with  shorter  flights  and  shorter 
preflight  treatments.  The  problem  with  this  is  that  as  treatment  on  Earth  is  lengthened,  damage 
accumulation  increases  to  such  an  extent  that  it  could  actually  cause  an  increase  in  fracture  risk 
before  entering  space.  Based  on  the  model’s  prediction  of  damage  increase,  preflight  treatment 
periods  longer  than  30  days  may  put  the  subjects  at  risk.  During  preflight  treatment,  the  subjects 
are  still  on  Earth  where  higher  stresses  cause  greater  increases  in  damage  as  compared  to  space. 
They  may  also  be  exposed  to  even  higher  stresses  due  to  exercises  in  preparation  for  the  mission. 
These  exercises,  combined  with  brittle  bones,  could  lead  to  fracture  before  flight. 

The  model  predicts  treatments  with  high  suppression  of  remodeling  activation  to  have  the 
highest  gain  in  BMD  at  the  end  of  flight,  and  the  lowest  BMD  values  1  year  postflight.  These 
treatments  almost  completely  inhibited  remodeling,  causing  large  amounts  of  damage  to 
accumulate.  Though  BMD  was  much  higher,  the  quality  of  bone  was  poor.  Upon  return  to  earth 
and  discontinuation  of  treatment,  bone  remodeling  was  no  longer  inhibited  and  responded  to  the 
high  amount  of  damage  by  removing  bone  at  a  much  greater  rate  than  bone  formation  occurred. 

Alternatively,  the  model  predicts  treatments  with  low  suppression  of  activation  frequency 
to  have  the  lowest  BMD  at  the  end  of  spaceflight,  but  they  had  the  highest  BMD  and  lowest 
amount  of  damage  1  year  postflight.  These  treatments  allowed  a  fair  amount  of  remodeling  to 
continue  in  space,  but  limited  it  enough  so  that  bone  loss  was  kept  to  a  minimal  amount  during 
flight.  A  majority  of  the  predicted  bone  loss  came  from  lost  damage,  so  upon  returning  to  earth 
damage  accumulation  did  not  further  activate  a  remodeling  response.  These  treatments  had  the 
largest  postflight  gains  in  BMD  because  the  response  was  mostly  due  to  loading  in  which  bone 
was  added  to  meet  the  strength  required  to  support  the  subject. 

The  limitations  of  this  model  occur  where  assumptions  have  been  made  due  to  the  lack  of 
available  information.  First,  the  coefficient  to  determine  the  rate  of  microdamage  accumulation 
was  kept  constant  throughout  the  simulation,  although  it  is  likely  to  change  in  space.  Other 
coefficients,  too,  such  as  the  damage  rate  exponent  or  the  BMU  activation  frequency 
coefficients,  are  likely  to  be  altered  in  space  and  would  benefit  from  further  study  of  bone 
remodeling  in  microgravity.  Second,  the  predicted  postflight  results  are  limited  by  the  fact  that 
they  are  based  on  the  same  stress  applied  preflight  even  though  postflight  recovery  programs 
enable  space  explorers  to  ease  back  into  full  loading.  This  high  postflight  stress  would  cause 
overpredictions  of  both  BMD  and  damage.  Also,  a  bone  balance  ratio  of  1 .0  was  instantly 
applied  upon  return  to  Earth,  when  it  is  more  likely  that  the  ratio  would  slowly  ease  back  down. 
Third,  the  simulation  applies  a  constant  stress  derived  from  bone  loss  to  a  section  of  bone  rather 
than  deriving  the  actual  strain  and  applying  it  to  a  3D  model  of  bone.  Using  a  finite  element 
model  would  create  a  more  accurate  remodeling  response  with  more  precise  loading  conditions 
and  allow  detailed  analysis  of  the  effects  of  specific  exercises  on  maintaining  bone  mass.  Lastly, 
the  model  does  not  take  into  account  effects  of  spaceflight  on  blood  flow,  drug  metabolism, 
tissue  binding,  drug  elimination,  fluid  shear  stress,  or  changes  in  hormone  levels.  Many  of  these 
affect  the  efficacy  of  the  drug  itself  Changes  to  fluid  shear  stress  in  a  microgravity  environment 
could  affect  the  mechanosensory  ability  of  bone  cells  to  sense  signals  indicating  bone  loading 
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and  would  lead  to  further  loss  of  bone  even  under  heavy  exercise.  Also,  although  the  model 
tracks  changes  to  the  populations  of  bone  cells,  it  only  accounts  for  changes  due  to  the 
remodeling  response  and  not  due  to  the  physiological  adaptations  that  may  occur  in 
mierogravity.  Changes  in  hormone  levels  or  physiological  alterations  to  the  populations  of  bone 
cells  could  significantly  alter  the  remodeling  response  in  space  and  the  response  to 
bisphosphonate  treatment. 

It  is  clear  that  the  model  would  significantly  benefit  from  further  studies  on  spaceflight. 
Although  the  model  has  to  overcome  the  many  unknown  variables  of  bone  remodeling, 
bisphosphonates,  and  mierogravity,  it  has  shown  the  ability  to  provide  potential  trends  for  future 
studies.  As  new  data  and  information  becomes  available,  the  model’s  accuracy  can  be  improved 
and  eould  eventually  be  a  tool  used  for  predicting  effects  of  other  treatments  as  well. 
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Conference  Abstract 


This  work  resulted  in  the  following  presentation  at  the  Orthopaedic  Research  Society  Annual 
Meeting: 


C  Gardina  and  SJ  Hazelwood:  Simulated  Bone  Mass  Preservation  and  Fracture  Risk 
Assessment  with  Bisphosphonate  Therapy  during  Spaceflight.  Transactions  of  the  55th  Annual 
Meeting  of  the  Orthopaedic  Research  Society  34:  740,  2009. 
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INTRODrCTION 

Bone  loss  has  long  been  recognized  as  a  potential  problem  for 
indiMduals  mvolved  in  space  flight.  The  effects  of  microgravirs’  result 
in  several  physiological  changes  for  astronauts,  including  the  adaptation 
of  bone  to  the  weightless  ensiroument  of  space.  For  longer  terra  flights, 
a  reported  92®  o  of  astronauts  experienced  at  least  5®o  loss  of  bone  while 
40®  0  experienced  at  least  a  10®o  bone  loss  [1],  In  addition,  on  returning 
to  Earth  foUowmg  space  flight,  these  adaptations  can  manifest 
themselves  mto  phs’sical  impairments  that  may  result  m  the  permanent 
loss  of  bone  nuneral  densits’  and  an  mcreased  risk  for  fracture  [2.3] 

Exercise  has  frequently  been  used  to  counter  the  effects  of  a 
inicrogra\it>’  en\*ironment  aud  has  been  helpfril  to  \  ar>*mg  degrees  for 
several  phv'siological  ss  stems.  but  has  not  been  effective  at  preventmg 
bone  loss  [1].  Bisphosphonates  are  dnigs  developed  to  treat  bone 
diseases  mvoh'uig  excessive  remodelmg.  With  their  abihn*  to  suppress 
bone  resorption  and  increase  bone  mass,  bisphosphonates.  either  alone 
or  in  combmation  with  an  exercise  program,  offer  tremendous  potential 
for  niaiutainmg  bone  during  space  flight  In  this  study,  we  use  a 
con^^utational  model  of  bone  remodelmg  and  bisphosphonate  treatment 
to  exanune  the  effects  of  bisphosphonates  on  presening  bone  mass  in  a 
iuicrogra\it\'  setting  durmg  space  flight  and  on  the  fracture  risk  of  bone 
for  the  subsequent  return  to  an  enviromuent  with  grasits*. 

METHODS 

This  study  utilized  a  modified  version  of  a  presionsly  developed 
computational  model  for  bone  remodelmg  and  bisphosphonate  treatment 

[4]  This  model  mcoiporates  the  coordinated  responses  of  BMUs  (basic 

multicellular  umts.  the  teams  of  bone  cells  that  resorb  and  form  bone)  to 
two  mechamcal  stimuh  that  initiate  remodeling;  disuse  and  fatigue 
damage.  The  model  tracks  the  interactive  changes  in  remodeling,  strain, 
and  nucrodamage  m  a  representative  volume  of  bone.  An  empirical 
relationship  was  used  to  relate  the  elastic  modulus  to  bone  \  olume 
fraction  (B\T).  Damage  and  disuse  were  quantified  in  tenus  of  the 
mechamcal  stimulus.  >  e"*,  des  eloped  by  Carter  and  co-workers 

[5] .  where  R4.  is  the  number  of  cycles  that  the  strain  t  is  apphed. 

The  damage  formation  rate  was  assumed  to  be  propomonal  to  <I>.  The 
rate  of  damage  removal  rate  was  a  ftinction  of  the  current  amount  of 
damage,  the  BMU  activation  frequencv’.  and  the  area  resorbed  by  BMUs. 
BMU  actmition  frequency  was  calculated  daily  from  the  amount  of 
disuse  and  existmg  damage.  The  numbers  of  resorbing  and  refilling 
BMUs  active  each  day  were  calculated  from  the  activation  frequency* 
history'  over  the  remodelmg  penod:  25  days  for  resorption  5  da\  s  for 
reversal,  and  64  days  for  refilhng.  Daily  B\T  changes  were  then 
calculated  from  the  net  amoimt  of  bone  removed  or  added  by  each 
resorbmg  or  refilling  BMU.  respectiveh*.  A  mechamsm  was  included  to 
allow  for  less  than  complete  refiUmg  on  trabecular  surfaces  in  disuse. 

Preflight  conditions  were  simulated  by  running  the  model  imtil  it 
reached  a  steady  state  with  a  B\T  of  0  22  (npical  for  adult  vertebral 
trabectilar  bone)  Microgni\‘ir>  was  modeled  by  reducing  the  load  to 
simulate  a  0.7® 0  bone  loss  oser  a  ISO  day  period  [1.6].  Bisphosphonate 
effects  were  simulated  by  suppressmg  activation  freqneiKy  based  on  the 
potency  of  the  drug  (low  and  high  potencies)  and  by  reducing  the  BMU 
resorption  area  [4].  Spaceflights  were  simulated  in  MatLab  for  manned 
mission  lengths  of  10.  90,  and  ISO  da\*s.  Changes  m  B\T  and  damage 
accumulation  were  anals^ed  durmg  and  up  to  1  year  after  spaceflight. 
Bisphosphonate  treatment  was  gn  en  for  the  duration  of  spaceflight  and 
began  either  at  the  stan  of  spaceflight  or  90  da>*s  before. 

RESIXTS 

B\T  and  microdamage  decreased  from  preflight  levels  due  to  the 
reduced  loads  m  a  microgra\ir>'  ensiroument  of  a  ISO  day  spaceflight 
without  bisphosphonate  treatment  (Figs  lA  and  IB)  While  B\T 
during  spaceflight  was  maintained  at  or  increased  above  preflight  levels 
with  bisphosphonate  treatment  of  low  and  high  potency,  respectively, 
damage  levels  also  mcreased  above  the  basehne  values  for  the  high 
potency  drug.  Following  the  return  to  the  gravitational  ensironment  of 
Earth.  B\T  for  the  high  potency  bisphosphonate  decreased  as 
remodeling  activation  increased  to  coimteract  the  higher  le\  el  of 


Figure  1.  Simulated  effects  of  spaceflight  and  bisphosphonate 
therapy  on  (A)  B\T  and  (B)  damage  accumulation  during  a  ISO  day 
space  misvion  and  for  565  das-s  following  the  retnrn  to  Earth. 

damage  (Figs  1 A  and  IB).  For  the  low  potency  drug,  postflight  B\T 
increased  abos’e  preflight  conditions  due  to  the  increased  loadmg  upon 
retunuug  to  Earth  while  damage  remained  below  the  preflight  le\  el. 

'  Results  were  similar  but  not  as  pronounced  for  the  1 0  and  90  day 
spaceflights.  \Mule  preflight  B\T  mcreased  with  bisphosphonate 
treatment  starting  90  days  prior  to  spaceflight.  B\T  le\  els  w  ere  not 
substantially  increased  at  1  year  after  renumng  to  Earth.  Preflight 
damage  les'els  also  mcreased  by  gning  bisphosphonates  prior  to  flight, 
and  remamed  elevated  follow'ing  the  renim  to  Earth 

DISCUSSION 

The  computer  model  des  eloped  here  combmed  a  bone  remodeling 
simulation  with  spaceflight  data  from  experimental  studies  m  order  to 
understand  the  ad\*erse  effects  of  micrograsits*  on  bone  and  explore 
potential  treatment  solutions  for  space  explorers.  The  model  predicted 
reduced  fracture  risk  with  the  low  potency  bisphosphonate  treatment  that 
increased  B\T  while  decreasing  accumulated  damage  1  year  after 
spaceflight.  For  the  treatment  highly  suppressmg  remodeling  activation, 
on  the  other  hand,  the  predicted  postflight  changes  mcluded  decreased 
B\T  with  increased  damage  accumulation  1  year  following  the  mission. 
Uhile  exercise  has  not  reversed  bone  loss  during  spaceflight,  it  is 
beneficial  for  several  physiological  ssxtems  of  space  explorers 
Bisphosphonates.  m  combination  with  exercise  and  diet,  may  help  m  the 
overall  benefit  of  those  ms  olved  in  spaceflight,  including  aidmg  m  the 
presen’ atiou  of  bone  mass  and  reduction  of  fracture  risk. 
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1.  Progress  Overview 

Recently,  many  efforts  were  made  on  the  research  of  Gallium-Nitride  (GaN)-bascd 
optoelectronic  semiconductor  devices,  due  to  their  vast  promising  applications,  such  as  solid 
state  light  sources,  and  ultraviolet  light  emitters  for  high-temperature  electronics.  In  some 
applications,  they  become  even  irreplaceable.  However,  GaN-based  semiconductors  have 
totally  different  optical  and  electrical  properties  when  compared  to  other  materials.  Researchers 
can  make  light  emitters,  such  as  laser  diode/  light  emitting  diode  (LD/LED)  out  of  GaN  based 
semiconductors.  But  the  mechanism  how  they  work  still  is  not  fully  understood.  This  work 
recovers  some  fundamental  issues  of  GaN-based  LED/LDs  including  the  study  of  device 
surface  structures  that  enhance  light  extraction  and  investigation  on  the  effects  that  influence 
the  power  transition  efficiency.  Wc  investigate  application  of  photonic  structure  (photonic 
lattice  or  photonic  crystal)  in  design  of  GaN  devices.  Furthermore,  we  evaluate  and  compare 
the  confinement  factor  of  the  gain  models  in  various  device  structures,  and  optimize  the  anti¬ 
guide  layer  design.  Third,  we  obtain  the  eigen-funetions  and  eigen  energies  in  quantum  wells 
(QWs)  for  our  proposed  and  optimized  structure  to  design  high  power  Lasers.  During  the 
project,  we  investigate  the  effect  of  the  free-earrier  theory  on  optical  gain  spectra,  and  compare 
GaN  bulk  material  and  QW  material  for  the  gain  properties.  Finally,  we  define  some  design 
rules  for  GaN-based  opto-eleetronie  devices  and  their  underlining  physics.  In  addition,  we  also 
did  initial  simulation  of  grating  design  on  solar  cells  for  efficiency  improvement  and  finished 
our  pervious  C3RP  2005  injection  locking  work. 

During  the  duration  of  this  research  program,  we  continue  and  expand  the  existing  collaboration 
between  Prof  Xiaomin  Jin  at  California  Polytechnic  State  University  (Cal  Poly,  USA)  and  Prof 
Bei  Zhang  and  GuoYi  Zhang’s  group  in  the  Research  Center  of  Wide-Gap  Semiconductors  at 
Peking  University  (PKU,  China).  We  collaborate  on  simulation,  fabrication,  and 
eharaeterization  of  photonic  lattiee-based  GaN  epitaxial  material  and  optoelectronic  devices. 
The  Cal  Poly  group  performs  simulation  and  theoretical  study,  proposes  novel  structures,  and 
characterizes  the  GaN-based  photonie-lattiee  structures.  The  PKU  group  performs  device 
growth  and  fabrication.  The  final  goal  is  to  optimize  the  device  design  and  yield  high 
perfonuanee  GaN  LDs  and  LEDs. 
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“Optimization  of  Top  Polymer  Gratings  to  Improve  GaN  LEDs  Light  Transmission”,  OSA 
JoumafChinese  Optics  letters  (Focus  Issue  Nano  Photics),  vol.6,  no.  10,  pp. 788-790,  2008. 

2)  X.  Jin,  B.  Y.  Tamg,  and  S.  L.  Chuang,  “Relative  Intensity  Noise  Study  in  the  Injeetion- 
loeked  Integrated  Eleetroabsorption  Modulator-Lasers”,  Solid  State  Elect.,  vol.  53,  pp.  95- 
101,  2009.  (Sponsored  by  award  #  ONR  N00014-05-1-0855  C3RP  2005,  finish  the  paper 
during  ONR#  NOOO 1 4-07- 1-1152) 

3)  X.  Jin,  B.  Zhang,  F.  Wang,  J.  Fliekinger,  S.  Jobe,  T.  Dai,  G.Y.  Zhang,  “International 
Engineering  Research  and  Educational  Activity  on  GaN  Lasers  and  LEDs”,  International 
Journal  of  Engineering  Research  and  Innovation  (IJERl),  Vol.  1,  No.  1,  Spring/Summer 
2009.  (accepted) 
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Kang,  and  Guo-Yi  Zhang,  "Study  of  Top  and  Bottom  Photonic  Gratings  on  Gallium 
Nitride  Light-emitting-diodes.”  The  Ninth  International  Conference  on  Solid  State 
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ABSTRACT 

In  this  paper,  we  present  an  analysis  of  gallium  nitride  (GaN)  quantum-well  (QW)  laser  diode  (LD)  by  numerical 
simulation.  Here  we  discuss  three  aspects  that  are  crucial  to  our  analysis.  First,  the  transverse  mode  pattern  is  studied, 
and  our  current  GaN  diode  laser  structure  is  discussed  with  optical  waveguide  mode  analysis.  Then  we  compare  the  QW 
design  of  the  laser  and  maximize  laser  modal  gain.  Finally,  we  report  the  influence  of  the  electron  block  (e-block)  layer 
on  lasing  performance  of  our  design. 


Keywords:  Gallium  Nitride,  semiconductor  laser,  transverse  modes 

1.  INTRODUCTION 

In  the  visible  color  spectrum,  there  are  three  primary  colors:  red,  green,  and  blue,  also  referred  to  as  RGB.  Through  the 
combination  of  these  three  colors,  all  the  other  colors  in  the  spectrum  can  be  created.  For  example,  the  combination  of 
red  and  green  would  produce  the  color  yellow.  Current  technology  has  found  efficient  ways  at  creating  both  red  and 
green  light  using  semiconductor  technology,  but  the  creation  of  blue  light  has  not  shared  this  immediate  success.  Blue 
light  has  remained  the  hardest  light  to  produce  efficiently  from  semiconductor  technologies.  This  has  been  the  main  road 
block  preventing  highly  efficient  laser  diodes  (LDs)  from  replacing  our  current  lighting  technologies. 

Blue  violet  light  is  close  to  the  shortest  wavelength  of  light  in  the  visible  spectrum.  At  the  wavelength  of  445nm,  it  still 
remains  the  hardest  light  to  produce  using  semiconductors,  because  the  bandgap  properties  of  the  materials  needed  to 
produce  such  a  wavelength  in  semiconductors  that  are  hard  to  find.  In  recent  years,  many  strides  have  been  made  in 
studying  and  researching  Gallium  Nitrate  or  Gallium  Nitride  (GaN)  as  a  material  to  yield  blue  light.  The  most  progress 
and  significant  strides  have  been  made  by  Dr.  Nakamura,  who  dedicated  much  of  his  research  to  the  chemical  growth  of 
GaN  compounds.  [I]  Before  Nakamura  found  a  solution  for  growing  GaN  semiconductors,  much  of  the  focus  for  blue 
light  semiconductors  was  spent  on  II- VI  materials  (where  II  and  VI  represent  the  group  number  on  the  Periodic  Table  of 
Elements).  GaN  is  a  III-V  material  and  is  a  much  harder  substance  to  deal  with  because  of  its  higher  lattice  defects  in 
comparison  to  II- VI  materials.  However  with  Nakamura’s  perilous  efforts,  he  eventually  found  a  technique  to  deposit 
GaN  compounds  and  created  the  first  GaN  semiconductor.  Since  Nakamura  has  shown  that  GaN  LED  semiconductors 
are  possible  in  1995,  fellow  scientists  across  the  world  have  worked  hard  to  further  the  development  and  efficiency  of 
blue  light  semiconductors  [1]. 

GaN  is  one  of  the  most  promising  materials  for  use  in  the  blue  and  ultraviolet  wavelength  region.  Since  the  room- 
temperature  (RT)  continuous-wave  (CW)  operation  of  GaN-based  lasers  were  reported  by  Nakamura  et  al.  1996,  [2]  one 
of  the  important  targets  on  the  GaN  LD  development  is  to  extend  the  operating  lifetime  by  reducing  the  operation  current 
or  current  density.  It  was  pointed  out  that  the  threshold  current  density  of  GaN  lasers  is  intrinsically  higher  than  that  of 
GaAs.  This  is  because  the  hole  effective  mass  of  wurtzite  (WZ)  GaN  is  much  heavier  than  that  of  conventional 
zincblcnde  materials  such  as  GaAs. [3]  To  decrease  the  threshold  current  density  in  GaN  lasers,  several  approaches  have 
been  proposed.  Most  of  the  papers  discuss  the  threshold  improvement  through  optical  gain  or  Quantum-well  (QW) 
analysis.  [4]-[6]  The  beginnings  of  111-V  laser  diode  devices  were  very  elementary  in  their  design  compared  to  current 
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designs.  The  GaN  diodes  eonsisted  of  a  substrate,  eladding,  eorc,  and  active  region.  Current  designs  have  more  complex 
structures  such  as  a  super  lattice  (SL),  quantum  wells,  and  e-bloeks.  Using  these  new  technologies,  devices  with  lower 
laser  thresholds  ean  be  created  thus  leading  to  more  effieient  devices.  In  this  work,  we  discuss  the  threshold  reduction  on 
GaN  QW  lasers  in  three  aspects:  1 )  optical  waveguide  design  and  mode  analysis;  2)  QW  design  and  modal  gain  analysis; 
3)  electron-  block  (e-black)  layer  design  for  optimization. 

2.  NUMERICAL  MODELING 


LaserMOD  is  an  integrated  software  package  developed  by  RSOFT  for  the  design  and  simulation  of  semiconductor 
lasers  and  active  photonic  structures.  [7]  It  is  a  fully  integrated  platform  with  a  user  friendly  parametrie  CAD  interfaee, 
nonunifonn  Delauney  mesh  generator,  material  libraries,  gain  and  mode  ealeulation  utilities,  simulation  engine,  standard 
and  eustom  plot  generation  utilities,  and  versatile  graphieal  viewing  utilities.  In  short,  the  LaserMOD  program  provides 
the  user  with  an  immense  environment  in  whieh  semieonduetor  deviees  ean  be  modeled  and  tested  based  on  their  user 
speeified  properties. 

2.1  Optical  Confinement  Factor  (OCF) 


The  optical  confinement  factor  (OCF)  of  a  chosen  mode  is  defined  as  the  ratio  of  the  energy  of  the  chosen  mode  located 
in  the  active  region  to  the  total  guided  energy  of  all  the  modes.  [8]  A  higher  OCF  for  a  certain  mode  indicates  there  is 
more  energy  in  the  active  region  for  that  mode.  High  energy  in  the  active  region  is  usually  a  sign  that  lasing  is  occurring. 
Thus,  whichever  mode  has  the  highest  OCF  will  be  the  lasing  mode.  The  optical  modes  arc  determined  from  the  solution 
of  the  Helmholtz  equation  via  simultaneous  as  below,  then  the  OCF  can  be  calculated. 


dv"  Sv 


E„{x,y,z)  =  Q 


where  v)exp(//:Q/7^^  ^z)  ,  ko  is  the  free-space  wave  vector,  and  8(x,  v)  is  the  complex 

dielectric  constant  profile  of  the  multiplayer  structure.  The  eigenvalues  are  given  by  the  effeetive  index  nefr.m-  The 
frequency  =  (0^  /cof  the  mode  is  solved  and  is  set  to  correspond  to  the  quantum  well  band  gap  energy.  The  OCF  can 
be  thought  of  as  the  fraction  of  the  energy  of  mode  that  is  located  at  the  active  region.  [9] 


2.2  Mathematical  Model  -  8x8  Kronig-Penney  (KP)  Model 


The  LaserMOD  simulation  software  uses  the  Kronig-Penney  (K  •  P)  model  to  model  the  bandgap  relationships  of  the 
different  materials.  The  K*  P  model  is  based  upon  the  splitting  of  allowed  electron  energies  as  the  interatomic  distance 
between  atoms  decreases  to  form  a  crystal.  The  K«P  method  involves  quantum  mechanics  and  a  solution  to 
Schrodingcr’s  wave  equation.  [10]  For  the  one  dimensional  crystal  structure,  a  periodic  well  function  can  be  used  to 
represent  the  crystal  lattice  structure.  This  is  because  when  the  potential  functions  of  atoms  arc  brought  close  together, 
the  net  potential  function  of  the  overlapping  regions  is  similar  to  a  periodic  function.  Using  the  specified  characteristics 
of  a  periodic  function  for  the  boundary  conditions  for  Schrodinger’s  equation,  a  plot  of  the  energy  E  as  a  function  of 
wave  number  k  can  be  generated,  which  describes  the  valence  band,  conduction  band,  and  the  allowed  energy  bands. 
However  for  two  dimensional  calculations,  matrices  become  a  necessary  addition  to  efficiently  solve  Sehrodinger’s  wave 
equation.  A  popular  method  for  solving  E  vs.  k  diagrams  is  using  8x8  matrices.  Using  special  matrix  rules  and  “tricks" 
(i.c.  Helmholtz  equation)  these  calculations  can  be  solved  with  a  computer  program.  Many  programs  have  been  written 
that  ean  solve  these  types  of  mathematical  problems.  We  chose  to  use  RSOFT’s  LaserMOD,  which  is  a  program  that  has 
a  CAD  interface  which  can  easily  and  quickly  calculate  all  the  necessary  properties  of  semiconductors. 

2.3  The  2D  nitride-based  laser  model 

A  2D  nitride-based  laser  model  is  developed,  which  is  shown  in  Fig.  1.  The  simulated  laser  structure  has  five  quantum- 
wells  (QWs).  A  similar  device  was  fabricated  at  Peking  University,  China.  One  of  the  project  goals  is  to  identify  design 
flaws  from  the  current  laser  design  and  to  reduce  the  laser  threshold.  To  avoid  the  meshing  difficulties  of  the  finite- 
clement  method,  the  classical  Ritz  simultaneous  iteration  is  combined  with  an  additional  optimization  to  analyze  closed 
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arbitrary  dieleetrie  waveguides.  [7]  LaserMOD  determines  the  eharge  distribution  using  Sehrodinger  equation.  The  laser 
simulation  is  based  on  8x8  K^F  band  structure  calculation  and  photon  rate  equation.  The  material  parameters  based  on 
recent  literature  values  and  some  experimental  data  were  used.  The  detailed  laser  structure  is  listed  in  Table.  1 . 


Fig.l  2D  GaN  laser  model  using  Rsoft  LaserMOD. 
Table.  1 .  Laser  diode  layer  structure  and  parameters. 


Layer 

Thickness  (nm) 

Refractive  Index  (n) 

p-GaN 

(contact) 

50 

2.55 

P‘ AIq.  I  zGao.RsN/GaN 

(p-SL  cladding) 

500 

2.53 

p-GaN 

(p-core) 

100 

2.55 

P‘Alo.35f*Ao.65N 

(e-block) 

20 

2.42 

n-GaN 

15 

2.55 

Ino  iGAo.9N/GaN 
(50Ws) 

67 

2.685/2.55 

n-GaN 

(n-core) 

100 

2.55 

n-Alo.i2Ga{)  j^gN/GaN 
(n-SL  cladding) 

800 

2.53 

n-GaN 

(Substrate  or  buffer) 

4000 

2.55 

Sapphire 

(Oxide) 

4000 

1.77 

3.  SIMULATION  RESULTS 


3.1  Lasing  mode  and  ghost  modes 

The  first  twenty  transverse  modes  in  the  above  GaN  LD  structure  are  calculated.  Fig.  2  shows  several  optical  mode 
patterns  of  GaN  LD.  When  sapphire  is  used  as  a  substrate  for  GaN  lasers,  the  dislocation  density  in  the  material  is 
usually  very  high.  To  control  the  defect  number  or  reduce  eraeks,  an  n-GaN  substrate  (or  buffer)  layer  (several  micron 
thick)  is  deposited  on  the  sapphire  substrate  before  growing  the  cladding  layer.  This  layer  has  higher  refractive  index 
compared  to  the  n-AlGaN/GaN  supper-lattiee  (SL)  cladding  layer.  Because  of  insufficient  cladding  thickness,  QW 
waveguide  and  n-GaN  substrate  waveguide  are  coupled  and  the  GaN  lasers  have  multi-waveguide  structures,  which 
support  strong  substrate  modes,  also  called  the  “ghost-mode”  phenomena.  [11]  Therefore,  the  fundamental  mode  of  the 
multi-layer  waveguide  is  usually  “ghost  mode”.  The  higher  order  mode  of  this  multi-layer  waveguide  is  usually  the 
lasing  mode.  The  optical  confinement  factor  is  also  very  low  even  for  the  lasing  mode,  about  several  percents.  This  leads 
to  lasing  problem  of  GaN  lasers.  Different  order  modes  have  different  optical  confinement  factor.  The  most  strongest- 
confined  mode  in  the  multilayer  waveguide  structure  ean  be  the  lasing  mode. 
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The  optical  modes  of  the  2D  simulation  are  shown  in  Fig.  2.  For  modes  0*^  through  7*^  the  modes  look  very  similar  to  the 
ID  results,  [12]  with  additional  modal  energy  being  layered  above  and  below  adjacent  energies.  The  mode  is  the 
lasing  mode  and  shows  the  optical  energy  confined  inside  the  active  region.  Modes  and  10^^  modes  continue  the  same 
trend  of  optical  energy  layering  as  modes  1  through  7.  However,  something  very  interesting  happens  in  mode  1 1*^.  For 
Mode  1  to  20**^,  the  modal  energy  splits  across  the  x-axis  horizontally.  The  next  few  modes  follow  this  new  horizontal 
trend.  The  energy  split  at  x-direetion  is  a  eharaeteristie  that  we  would  not  be  able  to  notice  without  doing  a  2D  model  and 
gives  insight  into  the  optical  energy  interaction  along  the  x-axis.  We  find  that  as  the  mode  increases,  the  optical  energies 
are  no  longer  contained  along  the  vertical  boundaries,  the  energies  split  and  are  shared  across  the  x-axis. 
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Fig.  2  Several  ghost  modes  and  lasing  mode  distributions:  (a)  0^^  order  mode,  (b)  P'  order  mode,  (c)  5’^  order  mode  (d)  order  mode 
or  the  lasing  mode,  (e)  1 1^^  order  mode,  and  (f)  20‘^  order  mode. 


From  our  calculation,  the  optical  confinement  factor  for  the  zero-order  mode  is  only  0.0000067%.  The  8*^  mode  has  the 
greatest  overlap  of  optical  field  with  the  quantum  well.  Its  optical  confinement  factor  is  8.67%,  which  agrees  with 
reported  data.  [13]  This  indicates  that  our  LDs  lasing  in  the  8^"  order  transverse  mode.  The  other  modes  are  substrate 
modes  or  ghost  modes  as  shown  in  Fig.  2.  Strong  substrate  modes  compete  with  the  lasing  modes  in  this  multi¬ 
waveguide  structure.  Optimizing  the  OCF  for  different  layer  thicknesses  is  very  important  in  lowering  the  lasing 
threshold  of  the  GaN  LD.  An  increase  in  the  OCF  means  that  more  light  is  being  confined  in  the  lasing  mode.  With  more 
light  focused  in  the  lasing  mode,  less  current  will  be  required  for  the  LD  to  achieve  lasing.  In  here,  we  demonstrate  how 
the  different  optical  modes  affect  the  Light  vs.  Current  curves  of  the  GaN  LD.  By  creating  a  new  laser  design  using  our 
optimized  thicknesses,  we  show  that  it  produces  lower  lasing  thresholds,  which  brings  us  one  step  closer  to  the  ultimate 
goal  in  meeting  the  expectations  of  using  laser  diodes  as  future  light  sources. 
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The  OCF  is  calculated  in  the  2D  design  for  GaN  substrate  layer  thicknesses  from  0-5|im.  Fig.  3  shows  the  values  of  the 
OCFs  simulated  and  for  what  mode  they  occurred.  The  lasing  mode  migrates  as  the  GaN  thickness  increases.  For  every 
increase  in  the  GaN  substrate  by  0.5|im  the  lasing  mode  jumps  up  a  mode.  For  example,  at  a  GaN  thickness  of  2.6pm  the 
lasing  mode  is  5^*^  mode,  but  increasing  the  GaN  thickness  to  3.1pm,  the  lasing  mode  migrates  to  the  6^^  mode.  Each 
mode  is  evenly  spaced  by  the  constant  of  0.5pm.  These  results  are  in  agreement  with  our  previous  ID  GaN  substrate 
simulation  results.  [12]  Using  the  original  design  from  Table  1,  the  simulated  OCF  for  the  lasing  mode  (8^*^  mode)  was 
8.6677%,  however  in  Fig.  3,  the  OCF  can  still  be  increased  if  the  GaN  thickness  is  increased  a  little.  Following  along  the 
line  that  represents  the  8^^  mode,  a  thickness  of  4.2pm  yields  an  OCF  of  8.6962%  which  is  a  0.02%  increase  over  the 
original  design.  Only  a  small  increase  in  the  OCF  was  possible  for  the  GaN  substrate  layer  showing  that  the  original 
layer  thickness  was  very  close  to  being  an  optimal  design. 


GaN  Thickness  (urn) 


Fig.  3.  The  OCF  vs.  GaN  substrate  thickness  (2D) 

It  is  expected  that  increasing  the  cladding  layer  thickness  will  lengthen  the  distance  that  the  light  has  to  tunnel  through  in 
order  to  get  into  the  substrate  waveguide.  This  will  prevent  optical  leakage  of  the  mode  into  the  absorbing,  high  index  p- 
contact  layer.  This  however  will  increase  the  impedance  as  it  would  also  lengthen  the  distance  the  current  would  have  to 
tunnel  through  and  therefore  increase  our  threshold  current.  By  adjusting  the  thickness  in  the  n-SL,  it  is  of  interest  to 
find  a  smaller  thickness  that  still  retains  a  high  OCF  and  a  thickness  that  prevents  mode  and  current  leakage.  It  is  also 
important  to  be  aware  that  creating  such  thin  coats  of  the  n-SL  still  remains  a  real  world  problem  and  although  a  thin  coat 
of  n-SL  may  lead  to  an  optimized  simulation,  creating  such  a  lasing  device  may  be  difficult.  By  increasing  the  cladding 
size,  we  are  looking  to  find  how  much  a  thickened  cladding  actually  affects  the  OCF.  We  expect  a  thickening  of  the  n-SL 
will  prevent  mode  leakage  from  reaching  the  substrate  and  thus  help  prevent  ghost  modes  therefore  leading  to  a  higher 
OCF. 


The  results  of  the  2D  simulation  with  varying  n-SL  thickness  (in  Fig.  4  (a))  arc  similar  to  those  Hatakoshi  calculated. 
[12][14]  As  the  cladding  thickness  is  increased,  the  8^^  mode  (lasing  mode)  gain  begins  to  confine  more  light.  As  the 
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lasing  mode  increases  in  its  OCF,  the  other  modes  begin  to  lose  the  light  they  had  originally  been  able  to  confine.  Thus 
as  the  cladding  thickness  increases  all  the  optical  energy  that  is  available  becomes  confined  only  in  the  8^^  mode.  This  is 
shown  in  Figure  4  (a).  This  result  shows  that  the  anti-guidc-like  or  ghost  mode  behavior  can  be  suppressed  by  increasing 
the  cladding  layer  thickness.  A  thick  cladding  layer  reduces  the  effect  of  the  outer  contact  layers,  but  still  is  conducive  to 
high-order  modes.  At  the  n-SL  thickness  of  the  original  design  (O.Sjam),  the  OCF  was  8.7128%  and  reaches  a  peak 
plateau  on  the  graph  at  8.7241%  at  a  thickness  of  1.4|am.  The  0.01%  increase  in  OCF  requires  almost  doubling  the 
thickness.  Thus  the  best  optimization  for  this  design  is  simply  leaving  it  alone.  The  original  design  yields  an  optimal 
OCF  for  its  relative  thickness.  The  p-SL  cladding  provides  the  same  waveguide  like  confinement  of  the  light  as  the  n-SL 
cladding,  shown  in  Fig.  4  (b),  but  it  differs  in  that  it  will  not  be  absorbing  electrons  like  the  p-SL  will  be.  By  adjusting 
the  thickness  of  the  p-SL,  we  hope  to  find  a  thickness  that  prevents  mode  leakage  into  the  p-contact  layer,  yet  still 
maintains  low  impedance.  The  adjustment  of  the  p-SL  cladding  layer  shows  a  different  increase  in  the  OCF  than  the  n- 
SL  plot.  It  is  interesting  to  point  out  however  that  the  thickening  of  the  p-SL  lattice  above  0. 1  pm  has  a  detrimental  effect 
on  the  maximum  OCF,  decreasing  it  from  a  maximum  of  8.7%  to  8.4%.  (It  is  important  to  note  that  it  is  the  OCF  at  a 
different  mode).  Thus  we  find  our  optimal  thickness  for  the  p-SL  that  yields  the  best  OCF  yet  remains  fairly  thin  is  at 
0.  Inm. 
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Fig.  4.  Optical  confinement  vs.  (a)  n-SL  and  (b)  p-SL  thickness 


The  GaN  core  layer  in  the  2D  simulation  has  a  refractive  index  greater  than  the  surrounding  cladding  layers  to  reflect  the 
light  back  towards  the  active  region.  A  thicker  core  layer  can  lead  to  more  optical  losses  due  to  the  large  area  the  light 
has  to  travel.  Thus  choosing  an  optimal  core  layer  thickness  is  important  in  creating  the  most  efficient  laser  diode.  The 
OCF  is  plotted  in  Fig.  5  for  n-GaN  layer  thicknesses  of  O-l  pm.  The  OCF  peaks  at  8.7027%  with  an  n-GaN  thickness  of 
0.075pm.  This  is  a  0.224%  increase  in  the  OCF  from  8.6762%  when  a  0. 1  pm  layer  is  used.  Thus  by  using  a  thinner  layer 
of  n-GaN  core  layer,  a  better  optical  confinement  can  be  achieved.  Fig.  5  shows  a  constant  decrease  in  the  OCF  as  the  n- 
GaN  thickness  is  increased  and  the  lasing  mode  migrates  to  lower  modes.  The  same  simulation  was  run  for  the  p-GaN 
core  layer  and  the  results  of  the  OCF  vs.  p-GaN  thickness  are  also  plotted  in  Fig. 5.  The  maximum  OCF  is  achieved  for 
small  thin  layers  of  p-GaN.  The  OCF  peaks  with  8.8664%  at  a  thickness  of  0.05pm.  This  is  a  0.2%  increase  over  the 
original  design  when  the  p-GaN  was  0. 1  pm  thick  and  had  an  OCF  of  8.6762%.  Similar  to  the  n-GaN  core  layer,  a  thinner 
layer  creates  better  optical  confinement. 
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Fig.  6  The  GaN  laser  simulation  for  (a)  far  field  pattern,  (b)  light  output  versus  current,  (c)  model  gain  of  all  the  transverse 
mode,  and  (d)  model  gain  of  lasing  mode  only. 
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To  prove  the  optical  mode  design  can  improve  CW  GaN  LD  operation,  the  threshold,  optical  power,  quality  of  far-filed, 
and  optical  gain  should  be  evaluated,  which  arc  the  most  important  issues  and  represents  the  laser  performance.  For 
examples,  in  2002,  Tojyo  et  al  reported  a  kink  free  output  of  over  lOOmW.  In  2005  Schwarz  et  al  reported  near-  and  far- 
ficld  study  of  GaN  LDs.  [15]  In  2007,  Laino  et  al  reported  results  on  substrate  mode  study.  And  in  2006,  [16] 
Witzigmann  et  al  reported  optical  gain  analysis.  [17]  Here  we  calculate  the  far  field  pattern,  model  gain,  optical  output, 
and  threshold  with  only  lasing  mode  (the  mode),  and  all  the  transverse  modes  to  demonstrate  the  ghost  mode  effects, 
shown  in  Fig.  6.  For  the  far  field  simulation,  we  normalized  the  optical  pattern  to  the  peak  value  for  comparison.  In  the 
figures,  lasing  mode  represents  the  8^*^  order  mode  only  simulation,  ‘'x  modes”  means  ”the  first  x  transverse  modes”.  The 
”8  modes”  means  modes  0  to  7.  For  the  case  of  ”5  modes”  or  “8  modes”,  there  is  no  lasing  mode  included  in  the 
calculation  and  LD  does  not  reach  threshold  for  lasing.  For  the  ”8  modes”,  “10  modes”,  and  “20  mode”  cases,  little 
modal  gain  is  obtained  from  laser,  which  is  about  10'^  cm  ^  Therefore  the  light  output  is  only  about  10'^  mW.  If  we 
calculate  those  results  with  only  8^*^  order  lasing  mode,  the  laser  can  reach  a  peak  gain  of  about  25cm'*,  lasing  output  is 
about  40mW  at  80mA,  and  threshold  is  about  19mA.  According  to  our  optical  field  analyses,  the  strong  ghost-modes 
compete  with  lasing-mode  in  GaN  Laser,  which  can  prevent  the  laser  from  lasing.  For  the  worst  case,  if  the  waveguide 
structure  supports  strong  ghost-modes,  the  GaN  laser  would  not  operate  even  though  the  active  region  quantum  well  is 
perfect.  Design  of  the  optical  waveguide  for  GaN  laser  system  is  very  important  to  achieve  efficient  lasing  condition.  In 
this  work,  we  find  that  the  n-GaN  substrate  thickness  is  the  major  factor  influencing  the  transverse  mode  pattern.  In  a 
related  work,  [12]  we  optimized  the  optical  waveguide  structure,  which  limits  the  ghost  modes,  and  maximizes 
confinement  factor  of  the  laser  structure,  in  order  to  reduce  lasing  threshold. 

3.2  The  Q\V  analysis  and  model  gain  simulation 

Quantum  wells  arc  designed  to  trap  electrons  in  a  2-D  environment.  The  wells  arc  designed  to  have  a  particular  bandgap 
energy  related  to  the  wavelength  of  light  emitted  by  the  laser  diode.  The  quantum  well  allows  the  electrons  to  gather 
more  densely  in  the  well  than  they  would  elsewhere.  It  is  easy  to  think  of  it  as  though  the  well  is  drawing  electrons 
towards  it  then  trapping  them.  (In  fact,  it  isn’t  so  much  that  the  wells  are  drawing  electrons  to  them  and  away  from  the 
other  parts  of  the  semiconductor;  instead  electrons  keep  falling  into  the  well,  and  the  well  becomes  saturated  and  full  that 
it  seems  as  though  the  well  is  attracting  electrons.)  This  packs  more  electrons  in  the  active  region  and  allows  more 
eleetrons  to  jump  the  bandgap  thereby  releasing  a  photon.  The  size  of  the  well  must  be  on  order  of  the  wavelength  of 
light  hoping  to  be  produeed.  Eaeh  well  is  created  by  creating  a  thin  layer  (the  well)  and  surrounding  it  by  thicker  layers 
of  a  different  material.  Thus  for  a  multi  quantum  well  (MQW)  design,  there  would  be  alternating  layers  of  bulk  and 
active  layers.  The  well  layer  is  made  from  the  normal  aetive  layer  material  with  a  lower  refractive  index  then  the 
surrounding  bulk  layers.  This  in  a  sense  is  like  having  many  tiny  optical  cavities  that  interact  with  photons  at  the 
quantum  level.  It  can  be  shown  that  the  more  quantum  wells  in  a  semiconductor,  the  larger  the  threshold  current 
beeomes.  This  is  because  when  there  arc  more  wells  for  the  electrons  to  fall  into,  a  higher  current  is  necessary  to  provide 
the  quantum  wells  with  enough  electrons  to  maintain  saturation  which  in  turn  is  the  foundation  of  lasing.  [18] 

Quantum  wells  have  many  advantages  in  the  design  a  laser  diode  structure.  First,  by  using  QWs,  one  has  the  freedom  to 
design  the  transition  energies,  which  ultimately  determines  the  wavelength  of  light  that  leaves  the  active  region  in  the 
form  of  spontaneous  emission.  Second,  since  QWs  have  a  small  volume,  the  free  carrier  eoneentration  in  the  QW  is  high 
and  at  high  free  earner  eoneentrations  non-radiative  deep-level  transitions  are  less  likely  thus  yielding  a  high  radiative 
efficiency.  Third,  due  to  the  small  size  of  the  quantum  wells,  the  carrier  density  required  to  aehieve  population  inversion 
(i.e.,  high  carrier  density  in  the  conduction  band,  compared  with  the  valenee  band)  is  small  and  therefore  the  threshold 
eurrent  density  of  QW  structures  is  low.  And  finally,  the  surface  reeombination  is  less  likely,  which  making  surface 
recombination  less  important  in  the  study  of  QWs.  [18] 

The  strueturc  we  simulated  here  has  a  wide  contact  with  a  uniform  eurrent  injection.  The  number  of  QWs,  the  QW 
width,  and  composition  fluctuations  play  central  roles  in  the  optimization  of  GaN  light-emitting  diodes  (LEDs)  and  LDs. 
l4]-[6]  [17]  Our  simulation  here  considers  number  of  QWs  and  composition.  We  choose  lasing  mode  only  simulation, 
without  considering  optical  mode  variation  for  simplification.  The  band  structure  of  QWs  is  computed  using  k®p 
method,  which  includes  coupling  effects  for  the  heavy-hole,  light-hole,  and  the  crystal-field  split  hole  dispersion.  The 
QW  is  InxGai.xN/GaN.  The  width  is  5nm/7nm  (well/barricr),  and  x=0. 1.  From  Fig.  7(a),  the  peak  modal  gain  increases 
from  17  cm  '  for  IQW  to  3.7  cm  *  for  3QWs.  Then  it  reduces  to  29.1  cm’*  and  25.3em‘*  for  4  QWs  and  5  QWs.  The  3 
QWs  Case  provides  the  highest  gain  peak.  This  agrees  with  the  light  optical  power-current  (LI)  curve  simulation  in  Fig. 
7(b).  The  carrier  densities  are  inhomogeneous  among  the  quantum  wells.  [19]  The  optical  gain  is  generated  only  in  three 
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QWs  on  the  p-side  for  our  case.  The  QWs  on  the  n-side  act  as  absorption  layers.  Therefore,  for  the  LDs  with  more  than 
three  QWs,  the  peak  gain  reduces,  which  results  the  light  output  slope  (or  quantum  efficiency)  reduction  in  LI  plots. 
From  the  threshold  and  gain  simulation,  it  is  important  to  decrease  the  number  of  wells.  Single  quantum  well  GaN  LD  is 
the  best  design  structure,  however  it  has  a  lot  of  fabrication  challenges.  Besides  the  above  gain  simulation,  wc  have 
varied  structural  parameters  and  ealeulate  the  threshold  currents  of  lasers.  The  threshold  current  increases  as  QW  number 
increases  and  decreases  with  InxGai.xN/GaN  composition  x,  as  shown  in  Fig.  8.  Higher  “In”  composition  in  the  QW  will 
obtain  higher  gain,  however  it  has  to  be  balanced  with  drawback  of  the  lattice  mismatch  and  deterioration  in  material 
quality  for  a  larger  “In”  fraction.  For  5  QW  case,  the  threshold  current  shows  little  composition  dependence,  while  x 
varies  from  0.08  to  012.  This  will  provide  good  threshold  stable  point  with  fabrication  tolerance. 
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Fig.7  (a)  Model  gain  and  (b)  LI  curve  simulation  for  Inoj  Ga  0  9N/GaN  single-QW  and  MQWs  without  e-block. 
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Fig.  8  Threshold  current  for  different  QW  composition  x:  InxGai.xN/GaN  and  QW  number. 
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3.3  Electron  Block  (e-Block)  Layer 


Electron  barrier  was  studied  around  late  1980s  for  GaAs/AlGaAs  laser  system  to  improve  the  electro-optical 
charactcristics/threshold  current  of  QW  lasers.  [20]  To  control  the  thermionic  emission  and  overflow  of  the  carriers  from 
QWs,  increasing  the  barrier  height  or  design  a  carrier  block  can  effectively  improve  carrier  eonfincmcnt,  and  therefore, 
reduce  threshold  current  for  higher  emission  efficiency.  Recently,  to  improve  the  GaN  threshold  and  obtain  high- 
powcr/high-tcmpcraturc  operation,  an  AlGaN  electron-blocking  layer  was  proposed  and  widely  used.  [21][22]  This 
barrier  is  located  on  the  p-side,  in  the  direct  vicinity  of  the  active  layer  of  the  GaN  laser.  The  electron  barrier  is  usually 
un-doped  to  avoid  free  carrier  absorption.  In  this  work,  we  design  a  20nm  thick  layer  of  Alo.35Gao.65N  (15nm  away)  on 
the  top  of  the  QWs  active  region.  The  LI  simulations  arc  presented  in  Fig.  9.  Compared  with  Fig.  7(b),  the  threshold 
currents  arc  much  smaller  for  the  c-block  ease,  and  the  optical  output  power  is  more  than  doubled.  In  this  design,  the  e- 
Block  is  a  p-doped  material  that  has  a  larger  band  gap  than  its  neighboring  materials.  The  e-Bloek  is  a  very  thin  layer 
that  is  added  next  to  the  active  layer  to  prevent  electrons  from  leaking  into  the  p-doped  side.  Electrons  that  overflow  into 
the  p-type  side  leads  to  leakage  current.  Leakage  current  is  detrimental  to  the  operation  of  the  LD  because  the  higher 
current  causes  heating  and  dissipates  non-lasing  energy  creating  an  inefficient  LD.  The  doped  structure  contains  an 
AlGaN  blocking  layer  that  prevents  electrons  in  the  active  region  from  moving  into  the  p-type  side.  The  c-block  only 
blocks  electrons  and  allows  the  holes  to  move  freely  from  the  p-type  side  into  the  active  region  unaffected.  If  a  high 
current  is  injected  across  the  diode  then  a  large  carrier  concentration  results  in  the  active  region.  This  leads  to  enhanced 
non-radiative  carrier  recombination  at  defects  and  to  an  escalation  of  electron  leakage  from  the  quantum  wells  into  the  p- 
sidc  of  the  diode,  despite  the  AlGaN  blocker  layer.  Thus  the  c-block  is  very  useful  in  preventing  leakage  current  up  to  a 
certain  current,  but  once  the  injected  current  becomes  very  high,  the  blocking  properties  arc  null  and  the  leakage 
electrons  causes  the  laser  to  heat,  degrade,  and  eventually  breakdown.  Increasing  the  band  gap  of  the  c-block  can  be  an 
effective  method  of  making  it  very  hard  for  electrons  to  leak  onto  the  p-side.  However,  an  increase  in  the  band  gap  of  the 
c-block  often  means  a  higher  content  of  A1  and  therefore  a  decrease  in  the  thermal  and  electrical  conductivities.  The 
decrease  in  the  thermal  and  electrical  conductivities  counteracts  the  improvement  of  the  large  band  gap  c-block. 


a) 

Fig. 9  (a)  Threshold  current  witL^without  e-block  and  (b)  LI  curve  with  e-block. 

4.  CONCLUSION 

GaN  laser  diode  simulation  results  arc  presented  for  the  GaN  laser  design.  We  discuss  the  optical  substrate  modes  in 
optical  waveguide.  Suppressing  substrate  mode  is  very  important  for  the  GaN  laser.  We  also  present  QW  modeling 
results  and  gain  simulation.  For  our  current  design,  3QWs  will  give  the  best  gain  performance.  Finally,  adding  e-block 
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layer  on  the  top  of  quantum-well  active  layer  will  reduee  threshold  by  about  30%  to  40%. 
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We  present  a  grating  model  of  two-dimensional  (2D)  rigorous  coupled  wave  analysis  (RCWA)  to  study 
top  diffraction  gratings  on  light-emitting  diodes  (LEDs).  We  compare  the  integrated-transmission  of  the 
non-grating,  rectangular-grating,  and  triangular-grating  cases  for  the  same  grating  period  of  6  pm,  and 
show  that  the  triangular  grating  has  the  best  performance.  For  the  triangular  grating  with  6-pm  period, 
the  LED  achieves  the  highest  light  transmission  at  6-pm  grating  bottom  width  and  2.9-pni  grating  depth. 
Compared  with  the  non-grating  case,  the  optimized  light  transmission  improvement  is  about  74.6%.  The 
simulation  agrees  with  the  experimental  data  of  the  thin  polymer  grating  encapsulated  flij^vchip  (FC') 
GaN- based  LEDs  for  the  light  extraction  improvement. 

OCIS  codes:  140.0140,  140.5960.  050.1950. 
doi:  10.3788/COL20080610.0788. 


In  general,  GaN  solid-state  lighting  is  very  critical  for  fu¬ 
ture  energy  conversion.  It  is  a  very  hot  research  area  and 
revolutionizes  the  lighting  industry,  and  is  being  called 
“the  next  generation  light  sources’’.  Customers  world¬ 
wide  use  light-emitting  diode  (LF]D)  chips  to  replace  tra¬ 
ditional  bulb  technology  with  solid-state  })roducts  that 
provide  a  powerful  and  energy-efficient  source  of  blue, 
green,  or  white  lights.  Growth  in  the  high-brightness 
LED  market  in  the  next  few  years  will  be  driven  by 
lighting,  display  backlighting,  and  automotive  applica¬ 
tions.  LEDs  are  the  advanced  form  of  a  lamp,  and  its 
development  can  and  will  continue  until  all  power  levels 
and  colors  are  realized.  Howev('r,  low  external  quantum 
efficiency  is  one  of  the  biggest  obstacles  for  the  GaN 
LED  development.  Because  of  the  high  refractive  in¬ 
dex  of  GaN-related  material  and/or  indium  tin  oxide 
(ITO)  top  contact  layers,  only  a  few  percentage  of  in¬ 
ternal  light  escapes  and  is  collected  outside.  Most  of 
the  light  generated  in  the  active  layer  experiences  to¬ 
tal  internal  reflection  and  loss  in  the  device  material. 
A  (‘ommon  way  to  solve  this  light  trapping  is  to  form 
nano/microstructiires  at  the  light  extraction  surface  or 
the  bottom  reflective  layer  of  the  LEDsI^“^l  It  has 
been  shown  that  the  micro-sized  patterning  of  the  ITO 
top  transparent  electrode^^*'!  or  one-dimensional  (ID) 
nano-patterned  structure  results  in  an  enhancement  of 
light  extraction  compared  with  conventional  LEDs  (C- 
LEDs)M. 

For  commercial  applications,  low  cost  and  simplicity 
in  fabrication  are  desired.  It  has  been  demonstrated  by 
Peking  University  in  2008  that  31.9%  of  the  light  extrac¬ 
tion  enhancement  was  achieved  by  using  the  triangular 
patterned  encapsulated  flip-chip  (PC)  GaN  LEDs  com¬ 
pared  with  C-LEDs^^l.  In  this  design,  the  surface  gratings 
and  the  encapsulation  of  a  polymer  can  be  simultane¬ 
ously  accomplished  in  a  single  procedure.  Therefore,  it 
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can  realize  thin  and  low-cost  LED  package.  Based  on 
this  work,  we  utilize  the  two-dimensional  (2D)  rigorous 
coupled  wave  analysis  (RCWA)^^^*^  to  GaN-based  LED 
grating  model  and  study  top  polymer  diffraction  grating 
on  GaN-based  LED  grating  model  design.  We  also  pro¬ 
vide  a  design  guideline  for  the  improvement  of  the  LED 
light  extraction  and  optimize  the  micro- patterned  poly¬ 
mer  top  grating  design.  To  keep  the  comparison  simple, 
we  still  keep  the  simulation  grating  period  fixed  to  G  /mi 
according  to  our  initial  experiment 
The  core  algorithm  of  the  model  is  based  on  RCWA  and 
enhanced  with  modal  transmission  line  theory.  RCWA 
represents  the  electromagnetic  fields  as  a  sum  of  coupled 
waves^^^•^^^  A  periodic  permittivity  function  is  repre¬ 
sented  using  Fourier  harmonics.  Each  coupled  wave  is 
related  to  a  Fourier  harmonic,  allowing  the  full  vectorial 
Maxwell’s  equations  to  be  solved  in  the  Fourier  domain. 
Currently,  plane  wa\T  incidence  is  assumed  and  the  ma¬ 
terial  is  assumed  lossless  to  simplify  the  calculation.  The 
schematic  diagrams  of  the  top  grating  lattices  for  the 
simulation  are  shown  in  Fig.  1  with  flat  interface  (non¬ 
grating),  rectangular  interface,  and  triangular  interface. 
The  plane  wave  is  incident  from  semi-infinite  homoge¬ 
nous  polymer  (refractive  index  is  1.5)  to  semi-infinite 
homogenous  air  (refractive  index  is  1.0).  The  incident 
angle  9  upon  the  normal  of  the  grating  varied  from  0°  to 
90°.  The  simulation  is  performed  at  460-nm  wavelength 
according  to  the  GaN  LED  experimental  spectra^’^K  For 
each  incident  angle  0,  we  calculate  the  —20  to  4-20  order 
diffraction  efficiency.  The  total  power  transmission  is 
calculated  at  the  end  of  simulation  by  summing  all  the 
diffraction  modes.  In  the  initial  simulation  (Fig.  2).  we 
calculate  three  cases  according  to  Fig.  1,  in  which  the 
cases  of  Figs.  1(b)  and  (c)  are  grating  period  A  =  6 
pm.  grating  height  d  =  4  pm,  and  grating  bottom  width 
le  =  3  pm.  Our  simulation  shows  that  the  critical  angle 
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Fig.  1.  Simulation  schematic  diagrams  of  the  top  grating 
lattices,  (a)  Flat  interface  (non-grating);  (b)  rectangular  in¬ 
terface;  (c)  triangular  interface. 


Fig.  2.  Comparison  of  transmission  for  non-grating  (flat), 
squared-grating,  and  triangular-grating  cases. 


is  9c  =  42°  for  the  non-grating  case.  For  the  incident 
angle  above  the  critical  angle  of  42°,  there  is  no  light 
transmission  for  the  non-grating  case,  which  agrees  with 
FVesneFs  law.  In  the  rectangular  and  triangular  cases 
for  comparison,  the  transmittance  is  a  little  lower  for 
the  incident  angle  below  the  critical  angle.  However,  the 
transmittance  of  the  gratings  is  significantly  increased 
for  the  incident  angle  above  the  critical  angle,  since  a 
grating  can  extract  some  trapped  light.  The  total  trans¬ 
mission  is  the  transmittance  integrated  over  the  entire 
region  of  9  from  0°  to  90°,  which  are  21.79%,  31.60%, 
and  34.13%  for  the  non-grating  case,  the  squared-grating 
case,  and  the  triangular-grating  case,  respectively.  Im¬ 
provements  of  about  45%  (squared)  and  56.6%  (triangu¬ 
lar)  are  obtained  over  the  non-grating  case.  This  means 
the  triangular-grating  has  a  higher  total  transmitting 
diffracting  effect  than  that  of  the  squared  grating.  In  the 
previous  experiments^),  the  enhancement  factor  of  light 
extraction  for  the  triangular  grating  (A  =  6  ^m,  d  =  4 
/im,  and  w  =  3  fim)  was  31.9%,  which  should  include 
light  transmission  from  GaN  layer  to  polymer  and  from 
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polymer  to  air.  Our  above  simulations  only  consider  the 
polymer  to  air  transmission.  If  we  include  GaN  to  poly¬ 
mer  transmission  efficiency  in  the  simulation,  the  total 
transmission  from  GaN  layer  to  air  should  be  8.40%  with 
triangular  grating  and  6.41%  without  grating,  which  is 
about  31.1%  improvement.  Our  triangular-grating  simu¬ 
lation  results  agree  with  the  experimental  data  presented 
in  Ref.  [9]  very  well. 

Increasing  the  top  grating  transmission  will  directly 
improve  the  total  light  extraction  of  LEDs.  To  keep  the 
simulation  time  short  and  simplify  the  problem,  we  still 
focus  on  the  polymer  grating  calculation  for  our  design 
optimization.  Figure  3  shows  the  simulation  results  of  the 
transmission  versus  the  incident  angle  for  the  triangular- 
grating  case.  The  grating  period  is  6  /im,  and  the  grating 
depth  is  4  //in.  The  bigger  the  grating  bottom  width,  the 
more  light  transmits  at  an  incident  angle  above  the  non¬ 
grating-case  critical  angle  and  the  less  light  transmits  at 
an  incident  angle  below  the  non-grating-case  critical  an¬ 
gle.  To  understand  the  total  transmission  efficiency,  we 
integrate  the  transmittance  over  the  incident  angle  and 
normalize  the  integration.  The  final  results  of  the  opti¬ 
mized  triangular  grating  for  period  A  =  6  //m  are  shown 
in  F^ig.  4.  At  a  small  value  of  the  grating  height  d,  the 
transmittance  improvement  at  the  large  incident  angle 
is  dominating.  At  the  largest  d  value  the  transmittance 
improvement  at  the  large  incident  angle  is  almost  equal 
to  the  transmittance  degradation  at  the  small  incident 
angle;  therefore  the  total  efficiency  will  not  be  improved 
any  more  with  the  further  increase  of  the  grating  height  d. 


Fig.  3.  Simulation  results  of  the  light  transmission  for  the 
triangular-grating  case.  A  =  6  //m,  d  =  4  fj,m. 


Fig.  4.  Light  transmission  versus  grating  height  for  different 
grating  bottom  widths  of  polymer  grating  at  the  period  of  6 
fim. 
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There  exists  ati  optimal  value  in  the  grating  depth  de¬ 
sign.  We  can  clearly  see  that  the  6-//ni  grating  width 
and  the  2.9- /ui a  grating  depth  provide  the  highest  light 
extraction  rate.  Compared  with  the  non-grating  case, 
the  maximum  light  enhancement  is  about  117%  for  the 
triangular-grating  case,  which  is  much  better  than  56.6% 
of  the  non-optimized  case  in  Fig.  2.  Onr  data  clearly 
shows  that  the  diffraction  of  the  grating  improves  the 
overall  light  extraction  of  the  GaN  LEDs. 

Even  though  onr  simulation  is  only  performed  at  one 
grating  period  value  (6  //ni),  this  is  a  very  representa¬ 
tive  and  informative  ca.se.  which  enlightens  several  de¬ 
sign  guidelines  for  the  GaN  LED  grating  clearly.  Firstly, 
at  the  same  grating  period,  the  triangular  grating  has 
the  best  performance  compared  with  the  non-grating  and 
sqnared-grating  cases.  Secondly,  for  the  triangular  grat¬ 
ing,  the  grating  bottom  width  {w)  should  be  set  to  the 
grating  period  (A)  to  obtain  the  highest  light  extraction 
efficiency.  Thirdly,  the  light  transmission  coefficient  of 
triangular  gratings  varies  according  to  either  ir  or  d  vari¬ 
ation,  which  cl  aiiges  the  light  incident  angle  at  the  in¬ 
terface  and  modifies  the  total  light  extraction.  The  grat¬ 
ings  can  greatly  improve  light  extraction  above  the  non¬ 
grating-case  critical  angle,  hut  decrease  the  light  extrac¬ 
tion  below  the  non-grating-case  critical  angle.  Overall, 
there  is  an  optimzation  point  for  the  design.  Fourthly, 
onr  triangular  grating  experimental  data^^^  is  right  on  our 
simulation  chart  Fig.  4.  This  shows  that  onr  experimen¬ 
tal  results  can  be  further  improved.  Finally,  there  are 
also  other  parameters,  such  as  grating  period  and  poly¬ 
mer  material  index  (can  be  equal  to  1.5,  1.4.  or  even  1.3) 
can  be  considered  in  onr  future  simulations  to  further 
improve  the  light  extraction  beyond  this  work. 

In  conclusion,  we  compare  the  flat  interface  (non¬ 
grating).  rectangular-grating,  and  triangular-grating 
cases,  and  show  that  the  triangular  grating  has  the  best 
performance.  1  or  the  triangular  grating  with  a  6-/um 
period,  the  LP]Ds  have  the  highest  light  transmission, 
which  reaches  the  maximum  output  at  6-//m  width  and 
2.9-/nn  grating  depth.  Comj)ared  with  the  non-grating 
case,  the  maximum  light  transmission  improvement  for 
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just  the  grating  is  about  117%.  If  we  include  the  GaN 
layer  in  the  simulation,  the  total  light  transmission  is 
about  11.19%,  which  is  an  improvement  of  about  74.6% 
upon  the  non-grating  case. 
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Abstract 

We  presenl  simulation  results  of  the  indium  tin 
oxide  (ITO)  lop  diffraction  grating  using  a  rigorous 
couple  wave  analysis  (RCWA)  for  GaN  LEDs.  We 
study  three  different  nanostructure  patterns: 
cylindrical  pillar  grating,  conical  pillar  grating,  and 
cylindrical  nano-hole  grating.  We  show  the  light 
transmission  improvement  with  nano-grating  designs 
and  present  design-charts  for  the  nano-hole  grating. 

1.  Introduction 

The  conventional  GaN-based  light-emitting  diodes 
(LEDs)  have  a  low  light  extraction  efficiency  caused 
by  the  total  internal  reflection.  A  common  way  to  solve 
this  light  trapping  is  to  etch  a  periodic  nano-structure  at 
the  light  extraction  surface  and/or  the  bottom  reflective 
layer  of  the  LEDs[l]-[4]. 

For  commercial  applications,  low  cost  and 
simplicity  in  fabrication  are  desired.  It  has  been 
demonstrated  by  Peking  University  in  2008  that  32% 
of  light  extraction  enhancement  was  achieved  by  using 
the  triangular  patterned  encapsulated  Flip-chip  (FC) 
GaN  LEDs  compared  to  C-LEDs  [5].  In  this  design, 
the  surface  gratings  and  the  encapsulation  of  a  polymer 
can  be  simultaneously  accomplished  in  a  single 
procedure;  additionally  it  provides  low  height  profile. 
Therefore,  it  can  realize  thin  and  low  cost  LED 
package.  However,  our  pervious  work  focuses  on 
mirco-scale  grating  patterns.  To  obtain  design 
guidelines  and  understand  design  parameters  in  the 
nano-scale,  we  developed  a  three-dimensional  (3D) 
rigorous  couple  wave  analysis  (RCWA)  GaN-based 
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light-emitting  diode  (LED)  grating  model  to  study  top 
diffraction  grating  design  using  Rsoft  DiffMod  [6].  In 
the  paper,  we  also  provide  a  design  charts  for  the 
improvement  of  the  LED  light  extraction  and  optimize 
the  nano-hole-pattemcd  polymer  top  grating  design. 

In  summary,  we  present  a  three-dimensional  (3D) 
rigorous  couple  wave  analysis  (RCWA)  GaN-based 
light-emitting  diode  (LED)  grating  model  to  study  the 
top  indium  tin  oxide  (ITO)  diffraction  grating 
performance  at  460nm  wavelength  in  order  to  improve 
the  GaN  LED  light  transmission  efficiency. 

2.  Design  simulation 

The  core  algorithm  of  the  model  is  based  on 
RCWA  and  enhanced  with  modal  transmission  line 
theory.  The  RCWA  [7]  [8]  represents  the 

electromagnetic  fields  as  a  sum  of  coupled  waves.  A 
periodic  permittivity  function  is  represented  using 
Fourier  harmonics.  Each  coupled  wave  is  related  to  a 
Fourier  harmonic,  allowing  the  full  vectorial 
Maxwell’s  equations  to  be  solved  in  the  Fourier 
domain.  Currently,  plane  wave  incidence  is  assumed 
and  material  is  lossless  to  simplify  the  calculation. 

Usually  it  is  not  very  practical  to  fabricate  all 
kinds  of  the  top  ITO  textures  or  patterns  to  select 
the  optimized  structure  [9][10].  Therefore,  we 
simulate  three  typical  gratings:  cylindrical  pillar 
grating,  conical  pillar  grating,  and  cylindrical  nano¬ 
hole  grating,  as  shown  in  Fig.  l(a)-(c).  The  detailed 
GaN  LED  layer  structure  is  also  presented  in  Fig.  2. 

In  our  device  design,  it  is  very  important  to  keep  a 
30nm-fixed  ITO  thinckness  at  bottom  of  the  grating. 

This  fixed  thickness  is  used  to  prevent  P-GaN  layer 
from  being  damaged  in  the  etching  process  and 

,  IEEE 

I  computer 

society 

218 


N00014-07-1-1152 


P.I. Susan  C.  Opava,  Ph.D, 


protect  the  overall  device  charaterization. 
Furthermore,  the  30nm-bottom  ITO  layer  also  acts  as 
the  current  injection  layer  to  protect  the  LED  1-V 
charaterization  from  being  effected  by  the  nano¬ 
structure. 


(C) 

Fig.  1  The  schematic  diagrams  of  the  top 
grating  simulation  a)  cylindrical  pillar 
grating,  b)  conical  pillar  grating,  and  c) 
cylindrical  nano-hole  grating 
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Fig.  2  The  detailed  LED  layer  structure  in  the 
models. 

In  the  grating  simulation  model,  there  are  three 
major  parameters  that  affect  the  light  extraction: 
grating  period  (A),  grating  height  (d),  and  bottom 
width  (w).  First,  according  to  our  fabrication 
capability,  we  choose  a  large  grating  period  A=300nm 
for  the  initial  calculation  [I  I].  We  sweep  the  other  two 
parameters  (d  and  w)  and  their  possible  permutations. 
The  simulation  results  are  shown  in  Fig.  2  (a)-(c).  For 
the  grating  height  (d)  smaller  than  60nm,  cylindrical 
pillar  grating  has  the  best  performance.  All  three  cases 
have  the  best  performance  at  larger  w  value  or  the 
small  air  filling  factor.  At  large  period  Avalue,  it  is 
recommended  to  make  shallow  nano-structure  to 
improve  light  transmission.  For  the  grating  height  (d) 
larger  than  60nm,  cylindrical  nano-hole  grating  has  the 
best  performance. 

In  general,  nano-hole  structure  can  improve  light 
extraction  in  a  wider  range  of  the  grating  height  (d). 
Nano-hole  is  also  easy  to  be  achieved  in  our 
fabrication  [ll].  We  furthermore  study  the  nano-hole 
grating  in  detail  (A=l40nm,  I80nm,  220nm,  and 
260nm  as  well),  and  shown  in  Fig.  4.  We  find  that  the 
A=l40nm  case  has  the  highest  light  extraction  output. 
Compared  to  the  no-grating  case,  the  light  extraction 
improvement  is  about  10%  for  the  230nm-depth  and 
1 20-width  grating.  However,  the  smaller  pattern  size 
raises  fabrication  challenges.  Actually,  the  large 
grating  period  is  not  an  idea  design  for  the  conical 
pillar  grating  and  the  nano-hole  grating. 
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(c) 

Figure  3.  The  simulation  results  a) 
cylindrical  pillar  grating,  b)  conical  pillar 
grating,  c)  cylindrical  nano-hole  grating  for 
grating  period  of  A=300nm. 
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(d) 

Fig.  4  Nano  hole  grating  simulation  results 
with  A=140, 180,  220,  260nm. 

3,  Conclusion 

In  this  paper,  we  present  the  simulation  results  of 
nano-scale  grating  design  in  GaN  LEDs.  We  compare 
three  different  grating  structures:  cylindrical  pillar 
grating,  conical  pillar  grating,  and  cylindrical  nano¬ 
hole  grating.  And  we  show  that  the  small  grating 
period  will  yield  more  light  extraction  efficiency. 
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ABSTRACT 

The  Gallium  Nitride  (GaN)  Light-Emitting-Diode  (LED)  bottom  refection  grating  simulation  and  results  are 
presented.  A  microstructure  GaN  bottom  grating,  either  conical  holes  or  cylindrical  holes,  was  calculated  and 
compared  with  the  non-grating  (flat)  case.  A  time  monitor  was  also  placed  just  above  the  top  of  the  LED  to  measure 
both  time  and  power  output  from  the  top  of  the  LED.  Many  different  scenarios  were  simulated  by  sweeping  three 
parameters  that  affected  the  structure  of  the  micro-structure  grating:  unit  cell  period  (A)  from  1  to  6  microns,  unit 
cell  width  (w)  from  1  to  6  microns,  and  unit  cell  grating  height  {d)  from  50  to  200nm.  The  simulation  results  show 
that  the  cylindrical  grating  case  has  a  98%  light  extraction  improvement,  and  the  conical  grating  case  has  a  109% 
light  extraction  improvement  compared  to  the  flat  plate  case. 

Keywords:  Gallium  Nitride,  light-emitting-diode,  grating 


1.  INTRODUCTION 

As  a  result  of  our  energy  conversation  efforts,  lighting  sources  have  become  one  of  the  hot  areas  of  research  due  to 
their  applications  in  a  variety  of  fields  such  as  lighting  displays,  bulb  technology,  and  photonics.  The  demands  of 
these  applications  require  low  power  consumption,  yet  a  high  brightness  and  luminosity  with  minimal  heat.  We  can 
even  control  the  color  contrast  of  the  device  and  create  a  full  color  set  with  red,  green,  and  blue  Light-Emitting- 
Diodcs  (LEDs)  [1].  LEDs  have  been  used  in  many  applications,  however  the  light  extraction  efficiency  is  still  very 
low  for  GaN  LEDs  due  to  several  factors:  Gallium  Nitride  (GaN)  has  a  low  critical  angle  that  traps  light  inside  the 
device  [2],  absorption  of  light  within  the  device  due  to  dislocations  and  defects  within  the  GaN  crystal  [3],  and 
device  design  and  structure  has  not  been  optimized  (ie.  epitaxial  side  up  vs.  epitaxial  side  down  chip  structures)  [4]. 
It  is  crucial  that  we  improve  GaN  LED  light  extraction  efficiency  and  reduce  energy  consumption. 

The  major  limitation  to  the  light  extraction  efficiency  is  the  light  trapping  due  to  GaN’s  low  critical  angle.  This 
applies  to  any  large  change  of  the  refraction  index  existing  between  layers,  such  as  between  the  solid  state  LED  and 
air,  and  the  solid  state  LED  and  a  resin.  It  has  been  shown  that  resins  increase  the  extraction  efficiency  due  to  the 
more  gradual  change  in  refraction,  allowing  more  light  emitting  out  due  to  the  larger  escape  angle  [5].  Many 
methods  of  improving  LED  efficiency  are  currently  being  explored.  Almost  all  of  these  methods  are  seeking  to 
extract  the  trapped  light  in  greater  quantity  and  faster  speed.  Those  methods  being  explored  are  placing  photonic 
crystals  or  nanostructure  grating  on  one  of  LED  layers  to  modify  the  effective  index  of  refraction  at  the  boundary  [6- 
7],  randomized  roughening  on  the  surface  of  the  device  [7-8],  slanted  device  configurations  that  result  in  pyramidal 
shapes  [7],  and  inverted  “flip-chip”  designs  that  put  the  epitaxial  side  upwards  or  downwards  [4]  [9]. 

The  second  inefficiency  of  GaN  LEDs  is  the  loss  of  light  from  absorption  due  to  dislocations  and  defects  within  the 
GaN  crystal.  These  are  impurities  that  absorb  the  light,  an  issue  when  light  is  trapped  inside  the  LED.  The  longer  it 
takes  to  extract  the  trapped  light,  the  more  the  photons  suffer  from  absorption.  So,  it  is  critical  that  we  find  methods 
to  extract  light  quickly  from  the  LED  before  the  energy  is  taken  by  absorption  [10-11].  A  grating  structure  helps 
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solve  this  issue  by  ereating  more  angles  of  eseape.  Various  struetures  exist,  sueh  as  eonieal,  pyramidal,  spherieal, 
eylindrieal,  and  so  on,  but  only  a  few  ean  be  realized  with  eurrent  fabrieation  teehniques.  To  help  mitigate  losses  due 
to  absorpuion  and  faeilitate  the  quiek  extraetion  of  photons,  gratings  ean  be  patterned  on  the  surfaee  of  or  within  the 
layers  of  the  LED  deviee,  providing  more  eseape  angles  than  flat  interfaee.  For  example,  through  modified  laser  lift¬ 
off  (M-LLO),  air  holes  at  a  4  mieron  period  are  patterned  on  undoped  GaN  (U-GaN)  instead  of  just  roughening  the 
surfaee  of  an  LED.  The  teehnique  uses  a  sapphire  baekplane,  UV  light,  and  a  high  power  KrF  laser  to  eteh  the 
nanostructure  onto  U-GaN  [12].  In  the  experiment  of  PKU,  grating  depths  varied  from  75nm  to  120nm  [12].  Other 
fabrieation  teehniques  exist  sueh  as  imprint  lithography  that  ean  produee  similar  air  holes  that  measure  180nm  in 
diameter  ,  with  a  depth  of  lOOnm,  and  a  period  of  295nm  [13].  Our  simulations  will  be  based  off  of  the  M-LLO 
manufaeluring  proeess  of  PKU  [12],  a  model  with  a  patterned  U-GaN  bottom  grating  layer  attaehed  to  a  refleetive 
Ag  film  is  persented.  The  grating  height  plays  a  role  in  transmittanee  and  refleetion,  sinee  the  larger  the  grating 
height,  the  more  gradual  the  effeetive  refraetion  index  will  be,  and  henee,  the  more  photons  that  will  be  transmitted 
versus  refleeted  and  absorbed  by  impurities  [6]  [14]. 

The  light  trapping  issue  is  eommonly  solved  by  etehing  a  periodie  strueture  at  the  light  extraetion  surfaee  and/or  the 
bottom  refleetive  layer  of  the  LED  [2].  This  paper  focuses  on  micro-scale  grating  structures  at  the  bottom  of  the 
device.  I'o  simulate  the  effects  on  extraction  efficiency,  we  use  a  Finite-Difference  Time-Domain  (FDTD)  GaN 
LED  model  at  460nm  wavelength  to  study  different  reflection  gratings.  The  GaN  reflection  gratings  using 
cylindrical-hole  bottom,  conical-hole  bottom,  and  non-grating  structures  arc  simulated  and  optimized.  In  the  paper, 
the  simulation  model  is  presented  in  section  2,  simulation  results  arc  presented  in  section  3,  and  the  conclusion  is  in 
section  4. 


2.  SIMULATION  MODEL 

The  presented  simulation  model  accounts  for  the  effects  of  refraction  in  device  materials,  reflection  due  to  linear 
dispersion  or  total  internal  reflection,  transmission  of  escaping  light  from  the  LED,  and  scattering  at  the  grating  [3]. 
The  form  of  analysis  used  in  the  simulation  is  the  common  solution  for  the  light  wave  propagation  in  arbitrary 
geometries,  the  Finite  Difference  Time  Domain  (FDTD)  technique.  This  allows  for  the  most  accurate  solution,  since 
FDTD  is  based  directly  on  Maxwell’s  curl  equations,  which  can  accurately  calculate  all  four  of  the  above  cases.  In 
conjunction  with  Maxwell’s  equation,  a  Yee  mesh  is  used  (shown  in  Fig.  1),  which  enables  analyzing  the 
electromagnetic  fields  on  a  grid  of  three-dimensional  space  and  time.  By  defining  an  incremental  variable  for  each 
parameter  in  space  and  time,  namely  Ax,  Ay,  Az,  and  At,  the  E  and  H  fields  for  a  specified  grid  are  obtained.  The 
model  allows  simulations  of  any  geometrical  structure  of  LEDs.  An  important  point  to  consider  is  that  the  smallest 
increment  must  be  no  smaller  than  the  smallest  feature  of  the  structure,  or  the  model  will  not  be  able  to  accurately 
calculate  the  exact  features  of  the  structure.  The  GaN  simulation  model  has  the  parameters  shown  in  Fig.  2.  The 
actual  LED  is  mounted  on  a  very  thick  layer  of  Si  submount  with  an  Ag  reflector  plate  directly  on  top  of  it.  The  Ag 
fills  the  L-GaN  air  holes  in  cither  a  conical  or  cylindrical  unit  cell  shape  (only  conical  is  shown  in  Fig.  2).  Adding 
the  submount  layer  will  add  a  large  amount  of  calculation  times.  However,  the  Ag  is  a  strong  reflective  layer  and 
effects  of  submount  on  the  EM  field  arc  very  trivial  compared  to  other  layers.  Therefore,  the  submount  is  not 
included  in  the  modal.  Finally,  an  n-GaN,  quantum  wells,  and  p-GaN  are  placed  on  top  of  the  grating.  The  time 
monitor  is  used  to  measure  the  time-varied  light  output  of  the  whole  device  and  is  separated  from  the  LED  by  a 
distance  of  lOOnm. 

The  model  has  cylindrical  holes  or  conical  holes  on  the  bottom  of  the  undoped  GaN  layer  as  shown  in  Fig.  2  and 
Fig.3.  The  conical  and  cylindrical  shapes  represent  Ag  material,  which  is  a  reflective  layer.  For  a  visual 
representation  of  the  grating  types,  the  conical  grating  model  is  demonstrated  in  Fig.  3(a),  while  the  cylindrical 
grating  model  is  demonstrated  in  Fig.  3(b).  To  define  a  regular  spacing  between  unit  cells  in  a  crystal  lattice 
arrangement,  we  employ  three  parameters:  unit-cell  period  (A),  unit-cell  height  (d),  and  unit-cell  width  (w),  all 
shown  in  Fig.  3.  The  unit-cell  period  is  the  length  from  centcr-to-center  between  unit  cells.  In  3-D,  the  parameter  w, 
represents  a  diameter  in  the  case  of  a  circular  structure  (ic.  sphere,  cone,  and  cylinder)  or  a  length  of  a  side  in  the 
case  of  a  box  structure  (ie.  cube,  rectangular  cube).  The  unit-cell  height  d  is  the  depth  of  the  bottom  hole.  The  limits 
of  the  parameters  arc  the  following:  50  <  d  <  200nm,  w  <  A  to  prevent  overlap,  and  the  smallest  element  must  be 
bigger  than  the  smallest  grid  size.  The  grating  height  parameters,  which  arc  fabricated,  range  from  75nm  to  1 20nm 
[12].  This  determines  our  simulation  rang.  More  over,  the  smallest  grating  height  d  value  is  determined  by  the 
minimum  grid  size  limit.  If  d<  50nm,  the  simulation  requires  much  smaller  girds  and  simulation  time.  And  our  data 
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also  show  little  improvement  of  light  extraction  at  d  smaller  than  60nm.  Further  more,  the  width  parameter  must  be 
less  than  or  equal  to  the  unit  cell  period  since  a  larger  value  would  indicate  overlap  of  the  cell  structure,  an  invalid 
state.  Finally,  the  last  limitation  is  that  the  smallest  element  must  be  greater  than  or  equal  to  the  smallest  grid  size,  as 
specified  in  the  Yee’s  mesh  simulation.  If  the  grid  was  not  fine  enough  to  “see”  the  layer,  then  it  may  be  missed 
when  calculating  for  the  E  and  H  fields  using  Maxwell’s  curl  equations.  This  also  determines  the  minimum  distance 
of  the  power  monitor  to  the  device  in  Fig.  2,  which  is  set  to  lOOnm  above  the  LED.  The  detailed  simulation  values 
are  shown  in  Table  1.  Fractions  of  microns  for  A  and  w  are  allowed  in  the  simulation,  however  they  were  not  used. 
The  overall  size  of  FDTD  simulation  area  is  also  fixed,  which  islOOpmx  lOOpm.  If  A=l|im,  there  are  100  unit 
cells.  For  A=6|im,  there  are  only  16.67  unit  cells.  The  grating  is  a  squared  matrix  as  shown  in  Fig.3.  A  point-source 
layer  with  constant  wave  is  placed  at  the  center  of  quantum  well  region. 


Hr 


Z 


a 


x 


y 


Fig.  1.  Yee’s  Mesh  Solution  to  Solve  Maxwell’s  Equations 


From  Top  to  Bottom 

■  Time  Monitor 
□  p-GaN 

■  Quantum  Wells 

■  n-GaN 

■  Undoped  GaN 
B  Ag  Reflector 

X  =  460nm 


Air  Gap 
(lOOnm) 


U-GaN  Layer 
(120nm+d) 

rAg  Reflector 
(200nm+d) 


Material  Index  of  Refraction  Height  (nm) 

p-GaN  2.55  200 

Quantum  Wells  2.685/2.55  (averaged)  67 

n-GaN  2.55  4000 

Undoped  GaN  2.55  1 20+d 

Ag  Reflector  Linear  dispersion  terms  200+d 


Fig.  2.  GaN  LED  simulation  model 
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(a)  (b) 

Fig.  3.  Grating  unit  cells  shape  on  GaN  material  (bottom  view):  (a)  Conical  and  (b)  Cylindrical 


Table  1.  Range  of  the  Simulation  Parameters 


GaN  LED  Model  Simulation  Parameters 
Simulation  Parameters  Deseriptions  Simulated  Ranges 
Parameter:  Brief  Description  :  Range: 

A  The  period  of  the  unit  eells  1  to  6  mierons 

w  The  width  of  eaeh  unit  eell  1  to  6  mierons 

d  The  height  of  eaeh  unit  cell  50  to  200  nm 


3.  SIMULATION  RESULTS  AND  DISCUSSIONS 

The  start  of  the  simulation  is  when  the  LED  turns  on  from  an  off  state.  There  is  a  monitor  at  a  distanee  of  lOOnm 
above  the  LED  to  collect  the  light  emission.  For  eaeh  strueture  simulation,  we  must  wait  until  the  LED/monitor 
reaeh  a  steady  state,  after  whieh  we  ean  extraet  the  eonstant  wave  (CW)  average  power.  Eaeh  simulation  sweep  of 
the  parameters  produees  a  set  of  20000  data  points  (2000fs  at  0.  Ifs/step),  and  from  this  data  set,  we  determine 
average  power  over  the  last  500fs.  In  this  range,  maximum  steady-state  power  is  radiated  due  to  the  CW  souree  and 
refleetions  from  the  grating.  This  proeedure  is  done  for  eaeh  ease. 

Fig.  4  shows  the  results  of  a  GaN  eonieal-hole  grating  simulation,  sweeping  from  A=lpm  to  A=6pm,  w^lpm  to 
w=6pm,  and  d=50nm  to  150nm.  Similarly,  Fig.  5  shows  the  results  of  a  GaN  eylindrieal-hole  grating  simulation, 
sweeping  over  the  same  range.  The  flat  plate  (non-grating)  results  are  shown  for  eaeh  graph  for  eomparison.  The 
average  powers  in  the  plots  are  the  maximum  average  output  power  of  the  LED  on  the  last  500fs  of  the  simulation  at 
steady  state.  For  the  eonieal-hole  grating,  there  is  maximum  light  extraetion  around  the  grating  height  d=90nm.  The 
average  power  inereases  as  grating  height  inereases  when  d<90nm,  and  the  average  power  decreases  as  the  grating 
height  inerease  from  90nm  to  1 50nm  for  most  eases.  For  the  same  grating  period,  the  smaller  grating  width  aehieves 
the  better  light  extraetion.  For  the  transmission  grating,  the  maximum  transmission  results  from  the  largest  grating 
width  ease  [15].  In  this  paper,  the  refleetion  gratings  are  simulated.  Sinee  the  refleeted  power  summed  with  the 
transmitted  power  equals  the  total  ineident  power,  a  maximum  transmission  strueture  is  A=w.  Then  the  maximum 
refleetion  grating  strueture  must  differ,  and  in  faet  be  opposite,  from  the  maximum  transmission  strueture.  When  w 
inereases  at  the  same  d,  the  total  light  extraetion  reduees  and  more  approaehes  to  the  flat  ease.  For  the  same  A  and 
w,  the  interfaee  angle  of  the  grating  section  changes  when  d  varies.  When  d=0,  whieh  is  flat  ease,  there  is  no 
improvement.  However,  it  is  very  hard  to  simulation  small  d  values  case.  With  d  increasing,  the  interfaee  angle 
inereases,  more  light  will  be  extracted  at  small  d<90nm.  When  d  is  approaehes  infinite,  the  grating  section  is  too 
thick  and  it  is  harder  for  the  reflected  light  to  pass  through  and  be  extracted.  Therefore  the  light  emission  effieiency 
drops  at  higher  d  values.  There  is  maximum  design  point  for  this  particular  strueture,  whieh  is  around  d=90nm.  The 
best  ease  in  our  simulation  is  109%  light  extraetion  improvement  at  grating  period  A=6pm,  grating  width  w=l|im, 
and  grating  height  d=90nm.  For  the  eonieal-hole  grating  ease,  there  are  two  effects  of  period  width  w:  1)  The 
percentage  of  grating  area  compared  to  the  total  device  area.  If  width  w=0,  there  is  no  effects  and  no  improvement 
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of  the  light  extraction.  When  w  increases  from  zero,  more  lights  should  be  able  to  be  extracted.  However,  we  didn’t 
simulation  w<l|im  (nano-structure).  2)  For  the  same  period  A  and  grating  height  d,  but  different  width  w,  the  angle 
of  the  Ag  and  GaN  interface  are  different.  When  w  increases,  the  angle  decreases  and  should  be  much  closer  to  the 
flat  case.  Therefore,  at  large  w,  the  light  extraction  should  decrease  as  w  increase.  Summarizing  above  two  cases, 
there  is  a  maximum  w  design  point  for  each  grating,  which  should  be  shown  in  Fig.  6(a).  However,  our  data  is  only 
calculated  down  to  w=lpm  gating.  The  maximum  grating  design  should  be  somewhere  below  1  pm  (nano¬ 
structure).  But  for  the  fabrication  view  point,  it  is  not  necessary  to  design  the  grating  to  nano-structure  at  our  current 
fabrication  capability.  In  the  theoretical  part,  the  other  factors  should  also  be  considered  for  the  nano-grating  design, 
i.e.  the  structure  is  compatible  or  smaller  than  the  light  wavelength. 

For  the  GaN  cylindrical  hole  grating  simulation,  shown  in  the  Fig.  5,  if  the  grating  width  w  equals  to  the  grating 
period,  there  arc  very  little  light  extraction  improvement.  In  most  case,  the  light  extraction  efficiency  is  even  worse 
compared  to  the  no  grating  case.  Light  emission  improvement  can  only  be  achieved  at  w<A  cases.  Similar  to  the 
GaN  conical  hole  grating  simulation,  the  smallest  grating  width  produces  the  highest  average  power  output.  There 
are  two  cases,  which  give  the  maximum  average  power  output:  one  is  97.9%  light  extraction  improvement  at  the 
grating  period  A=2  pm,  grating  width  w=l  pm,  grating  height  d=60nm  and  the  other  is  94.8%  light  extraction 
improvement  at  the  grating  period  A=6  pm,  grating  width  w=l  pm,  grating  height  d=90  nm.  For  the  cylindrical 
grating,  w=A  is  a  very  special  case,  since  the  shape  of  the  grating  is  totally  different.  There  are  only  four  separated 
islands  of  GaN  on  the  four  comers  of  the  unit  cell.  Our  results  show  this  case  is  worse  than  the  flat  surface  interface. 
Our  data  also  show  that  the  small  grating  period  is  not  preferred  for  the  micro-grating  design,  such  as  A=1  and  2 
pm.  This  is  contrast  to  conical  case,  for  A=1  or  2pm,  there  are  still  reasonable  grating  design  at  d=90nm. 


50  70  90  110  130  150 

Grating  Height  (nm) 


(d) 


(e) 


(0 


Fig.  4.  Average  power  for  the  conical  hole  grating  Case:  (a)  A=l,  (b)  A=2,  (c)  A=3,  (d)  A=4,  (e)  A=5,  and  (f)  A=6  pm. 
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The  summary  of  maximum  power  for  the  GaN  eonieal-  and  eylindrieal-hole  grating  is  shown  in  Fig.  6.  In  general, 
larger  grating  periods  have  higher  maximum  power  for  both  eases.  This  is  a  very  important  result  to  guide  our 
fabrieation  and  design.  This  implies  that  the  large-grating  design  is  preferred  in  miero-levels.  The  maximum  power 
linearly  deereases  with  inerease  of  grating  width  w.  Compared  to  eylindrieal-hole  grating,  the  eonieal  grating 
maximum  power  is  higher  at  larger  w  value.  The  eonieal  gratings  are  less  sensitive  to  A  and  w  values  for  the 
maximum  power  output,  whieh  is  also  preferred  by  fabrieation.  For  smaller  grating  width,  i.e.  w=l  pm,  the  two 
eases  (eonieal  and  eylindrieal)  has  little  differenee,  whieh  is  also  shown  in  Fig.  7.  Sinee  w=l  pm  ease  is  the  best 
ease  for  most  eireumstanees,  the  eomparison  of  the  eonieal-  and  eylindrieal-hole  grating  for  the  w=l  pm  ease  is 
shown  in  Fig.  7.  For  the  simulated  range.  Fig.  7  (a)  shows  the  peak  power  generated  by  eaeh  unit  eell  shape  and  for 
eaeh  grating  period.  Also,  the  grating  heights  in  nm  for  those  maximum  powers  are  shown  in  Fig.  7(b),  also  plotted 
against  the  grating  period  A.  The  eylindrieal  grating  ease  has  a  98%  improvement  eompared  to  the  flat  plate  ease  at 
a  grating  period  of  A=2pm,  and  a  unit  eell  width  of  w=lpm.  The  eonieal  grating  has  a  109%  improvement 
eompared  to  the  flat  plate  ease  at  a  grating  period  of  A=6pm,  and  a  unit  eell  width  of  w=lpm.  However,  the 
maximum  power  or  peak  power  locations  are  almost  same,  round  the  grating  height  d=  90nm  for  both  grating  cases 
at  larger  grating  period  (A>2pm).  In  the  other  words,  the  optimized  the  grating  height  is  90nm  for  most  cases.  In 
summary,  it  is  better  design  the  reflection  gratings  (conical  or  cylindrical)  at  larger  grating  period  A=6pm,  smaller 
grating  width  w=lpm,  and  the  grating  height  d  round  90nm.  Compared  to  cylindrical  gratings,  the  conical  grating 
has  more  design  tolanccs  on  the  grating  width  w  and  period  A. 


(a)  (b)  (c) 
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Fig.  6  Maximum  power  for  each  grating  period  A  and  grating  width  w:  a)  conical-hole  grating  and  b)  cylindrical-hole  grating. 
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Fig.  7.  Comparison  of  the  conical-  and  cylindrical-hole  grating  for  the  w=lpm  case  (a)  peak  power  and  (b)  the  grating  height  at 

peak  power. 


4.  CONCLUSION  AND  FUTURE  WORK 

A  simulation  model  using  FDTD  and  Yee  Mesh  to  calculate  GaN  LED  light  extraction  efficiency  was  used.  Three 
grating  parameters:  A,  w,  and  d  are  studied.  The  simulation  results  show  that  the  cylindrical  grating  case  has  a  94% 
improvement  of  the  light  extraction,  and  the  conical  grating  case  has  a  109%  improvement  compared  to  the  flat  plate 
case.  The  highest  efficiency  in  a  reflection  grating  results  when  w=lpm.  As  w  becomes  small  compared  to  A,  the 
maximum  average  output  power  increase.  For  both  conical-  or  cylindrical-hole  reflection  gratings,  it  is  better  design 
the  reflection  gratings  at  larger  grating  period,  (i.e.  A=6pm),  smaller  grating  width,  (i.e.  w=lpm),  and  the  grating 
height  d  round  90nm.Our  simulation  didn’t  reach  the  optimized  w  value,  which  should  be  less  than  1  micron. 
However,  when  simulating  grating  with  w<lpm,  nano-grating  characteristics  should  be  addressed,  which  is  our 
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future  work.  Further  more,  other  grating  matrix,  such  as  triangular  matrix,  hexagon  matrix,  8  Quasi-periodic 
Photonic  Crystals  (QPCs),  and  12QPCs,  should  also  be  investigated  in  the  future  as  well. 
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8.  Project  Results  5:  International  Research  and  Educational  Collaboration  on  GaN 

Emitters 
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Abstract 

Nowadays  eost  reduction  is  the  top  priority  for  most  US  companies  to  survive.  To  reduce 
operational  cost,  many  companies  chose  to  outsource  their  manufacturing  divisions  as 
well  as  R&D  divisions  to  Asia,  most  notably  China.  Therefore,  there  is  an  urgent  need  for 
US  engineers  who  are  able  to  make  a  liaison  between  US  headquarters  and  subdivisions 
in  China.  US  institutions  should  be  aware  of  this  trend  and  prepare  engineering  students 
for  that. 

We  established  a  long-term  International  Engineering  Education  and  Research 
Collaboration  Program  between  California  Polytechnic  State  University  (Cal  Poly),  USA 
and  Peking  University  (PKU),  Beijing,  China  on  GaN  light  emitter  research  in  the  past 
three  years.  We  focus  on  GaN  laser  diode  (LD)  research  for  the  first  year.  GaN  Light 
emitting  diode  (LED)  research  was  added  during  the  second  year.  The  project  begins  by 
having  faculty  members  working  in  PKU  for  one  summer.  The  collaboration  for  the  rest 
of  the  period  was  done  through  tele-conference  and  emails.  Cal  Poly  graduate  students 
are  grouped  with  graduate  students  in  PKU  and  worked  elosely  on  eertain  projects. 
Through  this  project,  our  students  obtained  experience  of  collaborating  with  foreign 
partners,  especially  awareness  of  culture  difference,  without  going  to  aboard.  Their  work 
assignments  are  clear,  yet  closely  related.  Our  students  focus  on  device  simulation  and 
foreign  students  work  on  GaN  device  fabrication.  Exchanging  results  is  necessary  for  the 
progress  on  both  sides,  which  encourage  them  to  actively  communicate  with  each  other. 
The  result  of  this  collaboration  is  successful  from  both  research  and  education  point  of 
view.  We  published  four  technical  papers  on  GaN-laser  research  in  the  past  year.  Student 
comments  on  both  sides  confirm  that  they  obtain  better  understanding  about  foreign 
cultures  and  they  think  it  is  helpful  for  them  to  pursue  a  career  in  a  multinational  firm. 
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1.  Motivation 

Nowadays,  A  new  set  of  challenge  faces  both  United  State  industry  and  educational 
institutions  [1-2],  Because  of  rapid  technology  development,  competition  among 
companies  is  now  globalized  and  intensified.  In  order  to  succeed,  a  company  must 
manage  to  face  these  competitions.  Cost  reduction  is  always  the  first  priority  for  most 
companies  to  survive.  To  reduce  operational  cost,  many  US  companies  have  already 
moved  part  of  their  manufacturing  and  R&D  centers  overseas,  and  they  plan  to  continue 
the  out-sourcing  process.  Southeast  Asia,  most  notably  China,  is  among  the  top  choices 
for  US  out-sourcing  because  of  its  fast  developing  speed,  boosting  economy  and  well- 
educated  engineering  work  force.  To  make  this  business  transition  smooth,  there  is  an 
urgent  need  for  our  engineers,  engineering  students,  and  instructors  to  have  direct 
interaction  with  their  international  counterparts  [3].  It  has  been  noticed  by  industries, 
governments,  and  institutions  that  our  university  graduates  in  US  are  inadequately 
prepared  for  the  challenges  brought  by  industrial  globalization.  Therefore,  we  are 
obligated  to  introduce  this  globalization  trend  to  our  students  and  provide  necessary 
training  for  them  to  successfully  compete  in  this  environment.  A  direct  solution  is  for  us 
to  establish  collaboration  among  faculties  and  students  between  US  and  oversea  partners. 

In  supplement  to  the  study-aboard  program  that  has  been  offered  for  years  in  Cal  Poly, 
we  initiated  a  collaborative  research/education  program  with  institutions  in  China.  This  is 
the  one  of  the  international  programs  in  Cal  Poly  that  focuses  on  both  research  and 
educational  aspects.  Our  international  partner  is  School  of  Physics,  Peking  University  in 
Beijing,  China.  The  goals  of  this  program  are: 

•  Improve  student’s  ability  to  work  in  a  multi-culture  environment; 

•  Improve  student’s  critical  thinking  and  independency  by  involving  them  in  an 
open-ended  research  project; 

•  Improve  student’s  technical  competency  by  letting  them  work  on  cutting-edge 
research  topics. 

The  major  objectives  of  this  cooperative  research  project  arc: 

•  Establish  long  term  collaborative  research  relationship  in  form  of 
telecommunication,  instructors  exchange  and  students’  exchange. 

•  Establish  routine  but  powerful  simulation,  fabrication  and  characterization 
methods; 

•  Optimize  design  to  achieve  high  performances  of  photonic  lattice-based  Gallium- 
Nitride  epitaxial  materials  and  optoelectronic  devices. 

2.  Introduction  of  PKU  and  Cal  Poly 

Peking  University  (PKU)  is  one  of  the  most  prestigious  higher  education  institutions  in 
China.  The  university  is  a  research  oriented  institution  that  is  ranked  No.  1  in  almost  all 
ranking  systems  in  China.  PKU  is  located  in  northwestern  side  of  Beijing,  where 
universities,  high-tech  companies  and  international  corporations  accumulate.  The 
university  currently  has  three  campuses  and  offers  programs  in  science,  engineering, 
business,  liberal  arts,  law  and  medication.  The  university  is  one  the  first  two  schools  in 
China  that  are  funded  by  China’s  strategic  development  plan  in  science,  technology  and 
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engineering.  PKU  has  110  years  of  history  and  has  a  long  tradition  in  international 
eollaboration.  Flueney  in  English  is  a  requirement  for  both  undergraduate  and  graduate 
students  in  PKU.  This  removes  the  language  obstaeles  for  this  eollaboration. 

California  Polyteehnie  State  University  (Cal  Poly)  is  one  of  the  23  eampuses  making  up 
the  California  State  University  system.  Cal  Poly  offers  programs  in  engineering,  seienee, 
business  and  liberal  arts,  of  whieh  eollege  of  engineering  is  the  largest  eollege  aeross 
eampus.  Cal  Poly  offers  baehelor  and  master  degrees  and  is  eategorized  as  teaehing 
oriented  institutions.  However,  in  order  to  prepare  our  students  with  the  most  advaneed 
teehnology,  most  of  our  faeulties  are  aetively  involved  in  advaneed  researehes,  espeeially 
those  in  eollege  of  engineering.  This  eollaboration  with  PKU  is  eertainly  moving  us  one 
step  further  in  that  direetion.  In  Eleetrieal  Engineering  department,  an  individual 
design/researeh  projeet  is  required  for  BS  degree  and  a  thesis  projeet  is  required  for  MS 
degree.  Students  that  are  involved  in  this  researeh  eollaboration  inelude  both 
undergraduate  and  graduate  students. 

3.  Technical  Merit  and  Research  Plan 

Recently,  many  efforts  were  made  on  the  research  of  Gallium-Nitride  (GaN)-bascd 
optoelectronic  semiconductor  devices,  due  to  their  vast  promising  applications,  such  as 
solid  state  light  sources,  and  ultraviolet  light  emitters  for  high-temperature  electronics 
[4,5].  In  some  applications,  they  become  even  irreplaceable.  However,  GaN-based 
semiconductors  have  totally  different  optical  and  electrical  properties  when  compared  to 
other  materials  [6-9].  Researchers  can  make  light  emitters,  such  as  laser  diode/light 
emitting  diode  (LD/LED)  out  of  GaN-based  semiconductors,  but  the  mechanism  for  their 
operation  has  not  been  fully  understood  yet.  This  research  covers  several  fundamental 
issues  of  GaN-based  LED/LDs  including  1)  the  study  of  device  surface  structures  that 
closely  associates  with  light  extraction;  2)  the  investigation  of  the  effects  that  influence 
the  power  transition  efficiency. 

For  the  technical  content  of  this  project,  a  five  years  research  plan  has  been  laid  out.  In 
the  first  year,  we  investigated  the  optical  transverse-mode  distribution  in  the  GaN  LDs, 
and  their  basic  lasing  characteristic.  In  the  second  year,  we  arc  studying  the  application  of 
nano-photonic  structure  (photonic  lattice  or  photonic  crystal)  in  design  of  GaN  devices. 
At  the  same  time,  we  are  evaluating  and  comparing  the  confinement  factor  of  the  gain 
models  in  various  GaN  device  structures,  and  optimizing  the  anti-guide  layer  design.  In 
the  next  three  years,  we  will  optimize  the  structure  to  design  high  power  lasers  or  LEDs, 
define  some  design  rules  for  GaN-based  opto-elcctronic  devices,  and  reveal  some  of  their 
underlining  physics. 

Cal  Poly  and  PKU  both  have  advantages  and  disadvantages  in  term  of  facilities  necessary 
for  this  project.  The  students  at  Cal  Poly  are  strong  in  term  of  employing  different 
softvv'are  models  to  perform  simulations.  The  research  group  lead  by  Dr.  Jin  at  Cal  Poly 
acquired  several  cutting-edge  simulation  packages  over  these  years,  which  make  the 
detailed  modeling  and  simulation  possible.  The  group  in  PKU  lead  by  Prof  Bei  Zhang  is 
strong  in  fabrication  and  characterization.  In  fact,  as  a  well-funded  research  university. 
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PKU  possesses  the  most  advanced  fabrication  and  characterization  facilities  that  are  not 
available  in  Cal  Poly.  Therefore,  the  student  in  PKU  will  prepare  some  characteristic  tests 
of  the  GaN-based  photonic-lattice  structures.  These  photonic  lattice  structures  become 
more  and  more  important  in  the  GaN-based  optoelectronic  devices. 

4.  Project  Outline 

The  collaboration  started  by  initial  meeting  between  research  groups  in  PKU  and  Cal 
Poly.  Dr.  Jin  represented  Cal  Poly  visited  the  research  labs  in  Peking  during  summer  of 
2006  (sponsored  by  Wang’s  Faculty  Fellowship).  The  innovative  idea  of  this  project  is 
that  we  can  have  students  experience  international  education  training  without  going 
aboard,  which  is  less  expensive  for  both  groups  of  students.  Research  collaboration  and 
communication  could  be  done  remotely  using  internet  and  tele-conferences.  This  idea  has 
worked  very  well.  Some  of  the  key  elements  of  this  collaboration  are: 

•  Professors  from  both  sides  should  be  the  leaders  of  the  project. 

•  The  project  needs  to  be  mutual  beneficial,  and  supported  with  complementary 
capabilities. 

•  At  the  beginning,  the  faculty  needs  to  work  at  the  international  institution  for  a 
sufficient  period  of  time  to  demonstrate  US  research  capabilities  and  to  gain  the  trust 
of  each  others. 

•  Because  of  the  current  communication  technology,  phone  conference  calls,  the 
internet,  and  email  can  be  used  to  facilitate  a  productive  research  relationship. 

•  We  build  one-to-one  student  relationship.  The  first  year,  a  Master  student  from  Cal 
Poly  partnered  with  one  PhD  student  in  PKU. 

•  We  build  “student-mentor”  relationships  focusing  on  the  research  topic. 

•  Each  year,  we  will  focus  on  different  tasks  on  GaN  LED  and  GaN  LD  development. 

5.  Detailed  Activities 

To  obtain  necessary  research  skills  for  this  international  project.  Cal  Poly  students  need 
to  take  EE403/443  (Fiber  Optic  Communication  and  Laboratory),  EE4 18/458  (Photonic 
Engineering  and  Laboratory),  EE335/375  (Electromagnetic  Fields  and  Transmission  and 
Laboratory^  EE402  (Electromagnetic  Waves),  EE524  course  (Solid  State  Electronics). 
Waveguide  and  photonic  devices  concepts  are  address  in  those  courses.  Basic  training 
through  senior  design  project  is  provided  to  students  before  they  get  involved. 

A  ID  GaN  LD  simulation  models  for  design  optimization  (Figure  1)  was  developed 
during  the  initial  visit  to  China.  This  model  reasonably  considered  the  optical  fields  in  the 
devices.  However,  this  model  has  not  included  the  lasing  action  simulation.  Therefore, 
the  project  activities  in  the  first  year  of  collaboration  were:  1)  to  improve  the  ID  model, 
2)  to  develop  a  2D  model  GaN  LD  model,  and  3)  comparison  of  the  enhanced  ID  model 
and  2D  results.  Three  Cal  Poly  students  and  two  students  in  PKU  are  involved  in  these 
activities.  Communication  between  faculty  advisors  and  students  on  both  side  are  key  to 
the  success  of  this  project.  As  mentioned  earlier,  students  in  Cal  Poly  are  in  charge  of 
model  development.  The  initial  results  are  transferred  to  students  in  PKU,  which  provide 
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guidance  for  their  fabrication  and  characterization  of  the  devices.  Characterization  results 
are  transferred  back  to  Cal  Poly  site,  where  students  at  Cal  Poly  improve  the  model  based 
on  the  physical  data.  Figure  2  shows  the  flow  chart  of  the  student-mentor  (two-level) 
communication  between  the  two  institutions  on  the  researeh  topies.  The  final  results  are 
the  device  designs. 

Ph  ase  One:  The  GaN-based  laser  diodes  (LDs)  have  attraeted  a  lot  of  attention  as  short 
wavelength  light  sourees  in  reeent  years.  However,  high  threshold  eurrent  and  short 
lifetimes  are  the  main  problems  in  these  lasers.  One  of  the  major  reasons  for  these 
drawbaeks  is  the  anti-guided-like  behavior  of  waveguide  mode  assoeiated  with  the  n- 
GaN  buffer  layer.  Cal  Poly  group  has  ealeulated  the  transverse  mode  distribution  of 
InGaN/GaN  laser  diodes,  whieh  was  demonstrated  at  PKU.  We  find  that  the  n-GaN 
buffer  thickness  is  an  important  parameter  in  the  lasing-mode  design,  and  point  out  that 
the  maximum  optieal-eonfinement-faetor  variation  is  due  to  transverse  mode  eoupling. 
Our  calculation  also  proves  that  the  eurrent  design  is  very  elose  to  an  optimal  design,  but 
still  has  more  room  to  inerease  the  optieal  eonfinement  faetor,  in  order  to  reduee  the 
lasing  threshold,  and  to  further  improve  laser  performanee,  sueh  as  lifetime  and  far-field 
patterns.  We  published  four  papers  Ref  [10-13]  on  this  researeh  topie. 
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Dr.  Jin,  starting  June 
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Figure  1  The  GaN  Quantum-Well  device  simulation  research 
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Figure  2  The  joint  research  team  at  Peking  University  and  California  Polytechnic 
State  University  with  the  two-level  communications 


Phase  Two:  Advancements  in  GaN-based  LED  technologies  have  been  growing  fast  too. 
But  a  common  problem  still  exists  in  conventional  LEDs.  Photons  are  trapped  in  the 
device  and  limit  the  amount  of  light  extracted.  Photonic  lattices  are  one  of  the  proposed 
solutions  of  the  problem.  Photonic  lattices  are  complex  arrays  of  microstructures  in  a 
solid  dielectric  material  that  can  control  and  radically  influence  the  propagation  of  light 
in  different  directions.  They  represent  a  new  engineering  discipline,  combining  the 
principles  of  electromagnetism  with  the  concepts  of  solid  state  physics.  Photonic  lattices 
have  numerous  applications  in  optics  and  optoelectronics  in  particular  to  GaN-based 
LEDs.  The  second  phase  of  collaboration  concentrates  on  the  simulation,  design,  and 
characterization  of  the  GaN-based  photonic  lattices  and  related  devices.  The  impact  of 
the  behavior  on  photonic  lattices  of  pillars  or  holes  with  different  symmetries,  periods  on 
the  performances  of  GaN-based  light  emitters  will  be  mainly  calculated  at  Cal  Poly. 
Approximately  6-8  more  undergraduate  and  graduate  students  are  involved  into  this 
project.  A  variety  of  photonic  lattice  structured  on  GaN-based  light  emitters  will  be 
fabricated  at  PKU  by  different  methods,  such  as  ion  beam  lithography,  FIB,  ICP  dry 
etching  and  nano-imprint  technique  etc.  Some  of  the  characteristics  of  the  structures  and 
devices  will  be  measured  by  both  groups. 

6.  Results 

In  July  2007,  a  formal  collaboration  contract  has  been  signed  by  professors  from  both 
sides  indicating  their  agreement  for  a  long-term  collaboration  for  the  next  4  years  until 
August  2011.  The  result  of  this  collaboration  is  successful  from  both  research  and 
education  point  of  view.  From  research  point  of  view,  the  collaboration  combined  the 
strength  of  Cal  Poly  and  PKU.  As  a  clear  indicator  of  technical  successfulness,  we  co¬ 
published  four  technical  papers  on  GaN-laser  research  in  the  past  year.  To  assess  the 
outcome  of  educational  merit  of  this  project,  we  collected  comments  and  suggestions 
from  students.  Student  comments  on  both  sides  confirm  that  they  obtain  better 
understanding  about  foreign  cultures  and  they  think  it  is  helpful  for  them  to  pursue  a 
career  in  a  multinational  firm.  Up  till  now,  six  students  who  involved  in  this  project 
finished  their  degree,  among  which  two  students  graduated  and  working  at  companies,  4 
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students  pursued  graduate  study.  All  students  eommented  that  their  experienee  of  multi- 
eulture  researeh  helped  them  in  the  job  interview  with  large  eorporations.  The  open- 
ended  researeh  projeet  gives  students  opportunity  to  aet  as  an  investigator,  while 
instruetors  serve  as  faeilitator.  All  students  eomment  that  their  eritieal  thinking  skills  are 
improved  and  they  are  more  eonfident  now  to  work  independently. 

7.  Key  elements  of  the  international  research  collaboration 

Previously,  beeause  of  the  laek  of  eommunieations,  international  professional  groups 
working  on  the  similar  researeh  projeets  didn't  exehange  ideas  before  the  publieation  of 
their  researeh  results.  Therefore  some  of  the  researeh  was  developed  redundantly,  whieh 
wasted  the  resourees  of  soeiety.  The  development  of  teleeommunieation  in  the  past 
deeade  opens  unpreeedented  opportunities  for  international  scholars.  The  researchers, 
leading  student-scholar  teams  around  the  world,  ean  use  each  others’  knowledge  and 
work  together  on  a  projeet  in  timely  fashion,  leading  to  what  we  call  international 
researeh  and  education  collaboration.  However,  there  are  no  universal  models  for  the 
international  collaboration.  Each  ease  has  its  unique  character.  In  our  project,  the  key 
elements  and  obstacles  of  building  the  international  researeh  collaboration  are  discussed 
below;  some  of  those  items  are  closely  related  to  each  others; 

•  “Trust”:  The  leaders  of  the  projeet  should  have  trust  and  understanding.  This  is  the 
first  and  the  most  important  aspect.  Even  with  the  traditional  international 
partnerships,  “Trust”  is  still  required  for  effective  international  collaboration.  In 
earlier  2006,  we  started  talking  about  this  projeet.  After  the  first  year  of  work,  in  July 
2007,  we  signed  the  collaboration  contract  for  the  next  four  years. 

•  Regular  communication  and  teamwork:  The  first  year  is  very  eritieal  to  set  the 
foundation  for  the  future  collaboration.  Each  team  leader  needs  to  response  very  fast 
to  the  requests  of  the  other  side.  Frequently  holding  tele-eonferenees  of  entire  group 
(including  both  US  and  foreign  teams)  has  paramount  importance  for  both  students 
and  faculty  to  get  connection  with  each  other,  not  only  on  technical  issues,  but  also 
on  working  habits  and  culture  differences.  Regular  communication  is  also  essential 
to  build  the  trust  bond. 

•  Management  skill'.  The  management  skill  of  the  professors  from  both  sides  is  very 
critical  throughout  the  project.  Researeh  work  needs  to  be  distributed  based  on  each 
party’s  strength.  In  our  ease.  Cal  Poly  possesses  advanced  design  environment  and 
PKU  has  cutting-edge  fabrication  clean  rooms.  Therefore,  Cal  Poly  is  in  charge  of 
design  validation  and  improvements,  while  PKU  is  in  charge  of  design  realization 
and  testing. 

•  Research  element:  Another  important  purpose  for  this  projeet  is  to  team-up  our 
students  (undergraduate  teaching  university)  with  a  foreign  researeh  university,  and 
be  exposed  to  advanced  researeh  topic. 

•  The  student-mentor  team  and  two-level  communications:  The  direct  discussion 
between  foreign  and  US  students  served  as  important  agents  for  inserting  an 
international  dimension  to  the  researeh  effort.  However,  the  discussion  between  the 
students  should  be  supervised  by  professors  to  control  the  technical  aspects  of  the 
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projects.  The  students  from  both  sides  also  need  to  present  their  work  to  each  other, 
and  to  the  two  groups  of  professors  for  discussions. 

•  Mutually  beneficial  topics:  This  is  an  important  motivation  for  the  project.  Good 
research  topics  and  project  goals  should  be  carefully  selected  by  the  professors  from 
both  sides.  Complementary  capabilities  of  both  sides  will  produce  mutual  benefits 
for  the  research,  and  strengthen  collaboration  in  the  future. 

•  Financial  independence:  It  is  very  difficult  to  apply  funding  from  the  other  country. 
We  decided  to  fund  research  independently.  We  are  in  charge  of  software 
development  funding.  Peking  University  in  China  will  fund  their  fabrication  facility. 
As  for  the  research  visits,  the  sending  country  pays  the  international  air  fares,  the 
host  country  pays  for  the  expenses  related  to  short  visit. 

•  Low  financial  burden  on  the  students  from  both-side:  For  students,  spending  a 
period  aboard  is  very  costly.  Students  also  have  to  plan  carefully  to  make  their 
curriculum  flexible  enough  to  allow  them  to  be  away  for  a  long  term  and  not  fall 
behind  in  other  courses.  Our  project  allows  the  students  to  get  some  international 
experience  without  having  to  deal  with  interruptions  in  their  regular  course  sequence. 
The  short  international  visit  is  only  an  option  and  enhancement  of  the  collaboration, 
not  a  necessary  component. 

•  The  foreign-born  US  scientists:  The  international  research  bridge  is  built  up  by 
international  students  from  China,  or  so  called  the  foreign-bom  US  scientists  and 
engineers.  The  foreign-bom  US  scientists  are  the  greatest  asset  in  promoting 
international  collaboration.  We  need  to  recognize  international  talent  which  lies  at 
the  center  of  the  cultural  diversity  needed  for  the  global  environment. 

•  Data  accessibility  around  the  world  {Spontaneous  global  communities):  The 
development  of  computers,  internet.  World  Wide  Web  (WWW),  and  fiber  optical 
communication  system  transforms  the  international  research  and  education  into  a 
global  scientific  enterprise.  The  current  technology  allows  the  formation  of 
spontaneous  international  learning  communities.  We  can  share  the  information,  such 
as  textual,  graphic,  and  multimedia  format  across  the  world.  This  shrinking  world 
provides  our  students  a  very  low  cost  international  education  environment.  It  is  can 
be  called  “Spontaneous  global  communities”. 

•  The  consciousness  of  foreign  countries:  The  consciousness  of  foreign  countries  is 
improved  throughout  the  project,  which  also  improve  US  students’  global 
understanding. 

•  International  co-authorship  for  the  research  results:  This  is  an  important  outcome 
of  the  international  educational  and  research  partnerships. 

•  Annual  visit:  Any  level  of  annual  visits  benefits  the  international  research  project. 

•  English:  English  is  the  basic  language  for  communication.  However,  US  students  are 
also  very  interested  in  learning  a  little  Chinese  besides  research  in  GaN  LDs  and 
LEDs.  Chinese  students  are  offered  an  unusual  learning  opportunity  of  presenting 
and  defending  their  projects  using  technical  English  terminology.  Students  from  both 
sides  are  working  towards  eliminating  the  linguistic  barrier. 

In  general,  this  project  builds  an  international  virtual  research  laboratory,  which  develops 

and  enhances  students’  awareness  of  humanity  and  the  world  around  them.  The  future 
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implementation  of  the  international  projects  will  depend  on  growth  and  sustenance  of 
these  relationships. 

8.  Future  Work 

This  eollaboration  is  well  established.  We  are  keeping  it  rolling  and  move  it  to  the  higher 
level.  In  the  summer  2008,  Dr.  Jin  will  be  a  visiting  professor  at  PKU  supported  by 
“ChunHui”  exehange  researeh  fellow,  Edueational  Department,  Chinese  government  to 
promote  further  interconnection. 

In  the  long  run,  the  partieipants  of  both  sides  will  exehange  visitors  during  the  period  of 
this  project.  Faculties  in  US  will  visit  PKU  to  discuss  and  adjust  each  year's  research 
topics  in  the  summer.  The  partieipants  of  PKU  group  will  bring  some  of  the  samples  to 
Cal  Poly  to  perform  characterizations  at  appropriate  times. 

In  summary.  Cal  Poly’s  milestones  for  the  next  few  years  on  the  international  research 
and  education  are: 

•  Students  from  the  two  universities  will  make  presentations  to  each  other  through 
internet. 

•  Involvement  of  undergraduate  students  in  the  researeh,  which  will  be  a  challenge 
because  of  the  short  period  of  time  available  for  undergraduates. 

•  Seek  funding  to  send  students  to  China  in  future  summers  to  really  immerse  them 
in  international  environment. 

•  Seek  research  projects  with  research  laboratories  of  US  or  China  companies. 
Some  initial  contacts  have  been  made  between  Cal  Poly  and  some  globalized 
corporations,  such  as  Agilent  Technologies.  Although  there  are  more  hurdles  in 
the  University-Industry  researeh  eollaboration,  such  as  Intellectual  Property  (IP), 
both  parties  still  believe  a  mutual  beneficial  agreement  is  possible. 

9.  Conclusion 

We  established  a  long  term  International  Education  and  Researeh  Collaboration  Program 
(lERCP),  which  can  be  a  model  for  other  universities.  The  model  started  by  faculty 
visiting  and  expanded  to  international  students’  team-up  and  eollaboration.  With 
awareness  of  current  technology  development  trends,  we  established  a  joint  researeh 
program,  and  are  developing  international  edueational  activities.  This  eollaboration  helps 
our  students  adapting  themselves  to  a  globalized  environment  and  simultaneously 
promotes  advances  in  science  and  technology  by  involving  in  eutting-edge  GaN  LED 
researeh.  In  summary,  the  result  of  this  collaboration  is  successful  from  both  researeh  and 
education  point  of  view.  We  published  four  technical  papers  on  GaN-laser  research  in  the 
past  year.  Student  comments  on  both  sides  eonfirm  that  they  obtain  better  understanding 
about  foreign  cultures  and  they  think  it  is  helpful  for  them  to  pursue  a  career  in  a 
multinational  firm. 

Acknowledgments 


Proceedings  of  The  2008  lAJC-IJME  International  Conference. 
ISBN  978-1-60643-379-9 


240 


N00014-07-1-1152 


P.l. Susan  C.  Opava,  Ph.D. 


This  project  is  supported  by  the  Wang  Faculty  Fellowship  2006-2007  through  California 
State  University  (CSU)  International  Programs  USA;  Department  of  the  Navy,  Office  of 
Naval  Research,  under  Award  #  N00014-07-1-1 152,  USA;  “ChunHui”  exchange  research 
fellow  2008,  Educational  Department,  China;  973  program-National  Basic  Research 
Program  of  China  (2007CB307004);  High  Technology  program  (863-2006AA03A1 13) 
and  National  Nature  Science  Foundation  of  China  (60276034,  60577030  and  60607003). 


Bibliography 

[1]  Gerstenfeld,  A.,  Njoroge,  R.J.,  “Foundation  and  funding  opportunities  for 
globalization”.  Technology  and  Society,  ISTAS  '04.  International  Symposium,  pi 26 

-  132,  2004. 

[2]  Jewell,  T.K.  and  W.W.  Thomas,  “Benefit/cost  analysis  for  international  study 
options”, 

Technology  and  Society,  ISTAS  '04.  International  Symposium,  pi 33  -  138,  2004. 

[3]  Brown,  C.G.,  “Rethinking  the  fundamentals  of  international  scientific  cooperation 
in  the  early  twenty-first  century”,  2000  IEEE  EMBS  International  Conference,  pi 36 

-  145,  2000. 

[4]  Nakamura,  S.,  M.  Senoh,  S.  Nagahama,  N.  Iwasa,  T.  Yamada,  T.  Matsushita,  Y. 
Sugimoto,  and  H.  Kiyoku,  “Room-temperature  continuous-wave  operation  of 
InGaN  multi-quantum-well  structure  laser  diodes”,  Appl.  Phys.  Lett,  vol  69,  4056, 
1996. 

[5]  Suzuki,  M.,  T.  Uenoyama,  and  A.  Yanase,  “First-principles  calculations  of 
effective-mass  parameters  of  AIN  and  GaN”,  Phys.  Rev.  B.  vol  52,  8132,  1995. 

[6]  Suzuki,  M.  and  T.  Uenoyama,  “Strain  effect  on  electronic  and  optical  properties  of 
GaN/AlGaN  quantum-well  lasers”,  J.  Appl.  Phys.  vol  80,  6868,  1996. 

[7]  Ohtoshi,  T.,  A.  Niwa,  and  T.  Kuroda,  “Dependence  of  optical  gain  on  crystal 
orientation  in  wurtzite-GaN  strained  quantum-well  lasers”,  J.  Appl.  Phys.  vol  82, 
1518,  1997. 

[8]  Domen,  K.,  K.  Horino,  A.  Kuramata,  and  T.  Tanahashi,  “Optical  gain  for  wurtzite 
GaN  with  anisotropic  strain  in  c  plane”,  Appl.  Phys.  Lett,  vol  70,  987,  1997. 

[9]  Witzigmann,  B.,  V.  Laino,  M.  Luisier,  U.T.  Schwarz,  H.  Fischer,  G.  Feicht,  W. 
Wegscheider,  C.  Rumbolz,  A.  Lell,  and  V.  Harle,  “Analysis  of  temperature- 
dependent  optical  gain  in  GaN-InGaN  quantum-well  structures”,  IEEE.  PTL.  vol 
18,  1600,  2006. 

[10]  Jin,  X.,  B.  Zhang,  L.  Chen,  and  G.  Zhang,  "The  Optimization  of  Gallium  Nitride- 
Based  Laser  Diode  through  Transverse  Modes  Analysis",  Chinese  Optics  letters,  vol 
10,  no.  5,  588-590,  2007. 

[1 1]  Jin,  X.,  B.  Zhang,  T.  Dai,  and  G.  Zhang,  “Effects  of  Transverse  Mode  Coupling  and 
Optical  Confinement  Factor  on  Gallium  Nitride-Based  Laser  Diode”,  Chinese 
Physics,  vol  17,  no.4,  1274-1278,  2008. 

[12]  Jin,  X.,  B.  Zhang,  L.  Chen,  S.  Jobe,  T.  Dai,  and  G.  Zhang,  “The  Optimization  of 
Gallium  Nitride-Based  Laser  Diode  through  Transverse  Modes  Calculation”  The 


Proceedings  of  The  2008  lAJC-IJME  International  Conference. 
ISBN  978-1-60643-379-9 


241 


N00014  07-1-1152 


P. I. Susan  C.  Opava,  Ph.D. 


OSA  Topical  Conference  on  Nanophotonics  (NANO  2007),  Hangzhou,  China,  June 
18-21,2007, 

[13]  Jin,  X.,  B.  Zhang,  S.  Jobe,  J.  DeLeon,  J.  Flickinger,  T.  Dai,  G.  Zhang,  E.  Heller,  and 
L.  Chen,  “Two-Dimension  Simulation  of  Gallium  Nitride-Based  Laser  Diode”,  The 
7"’  International  Conferenee  on  Numerieal  Simulation  of  Optoeleetronic  Devices, 
Delaware,  United  States,  September  24  -  27,  2007. 


Biographical  Information 

Dr.  XIAOMIN  JIN:  received  her  Ph.D  from  Univ.  of  Illinois,  Urbana-Champion  in  2001.  She 
has  worked  in  the  research  laboratories  at  Coming  Lasertron  Inc,  W.  L.  Gore  and  associates,  and 
Optical  Communication  Products,  Inc.  Now  she  is  an  assistant  professor  at  California 
Polytechnic  State  University.  Her  research  focuses  on  fiber  optical  communication  and 
optoelectronic  devices. 

Dr.  BEI  ZHANG:  is  a  professor  of  Physics  in  School  of  Physics,  Peking  University.  She 
graduated  from  Department  of  Physics,  Peking  University  in  1962.  Recently  her  research 
is  focused  on  the  photonic  lattices  based  GaN  system  light  emitting  devices  (laser  diode 
and  LEDs). 

Dr.  FEI  WANG:  received  her  Ph.D  from  Univ.  of  Cincinnati  in  2005.  She  joined 
California  Polytechnic  State  University  as  an  assistant  professor  in  2005.  Now  she  is  an 
assistant  professor  in  California  State  University,  Long  Beaeh.  Her  research  focuses  on 
electronic  materials  and  devices. 

Dr.  GUOYI  ZHANG:  is  a  professor  of  School  of  Physics  and  Director  of  Research 
Center  for  Wide-band  Gap  Semiconductors,  Peking  University,  China.  His  research 
focuses  on  MOCVD  techniques  and  GaN-based  materials  and  devices.  His  recent 
research  projects  include  GaN  short  wave  length  laser  diodes,  GaMnN  dilute 
semiconductor  and  polarized  LED. 


Proceedings  of  The  2008  lAJC-IJME  International  Conference. 
ISBN  978-1-60643-379-9 


242 


NOOO 14-07-1-1 152 


P.l. Susan  C.  Opava,  Ph.D. 


9.  Project  Results  6:  Study  of  Photonic  Lattices  for  Soiar  Celis 

Reiated  paper:  Xiaomin  Jin  and  Simeon  Trieu,  “Improvement  of  Light  Transmission  using 
Photonic  Lattices  for  Solar  Cells,”  OSA  Topical  meeting,  Solar  Energy:  New  Materials  and 
Nanostructured  Devices  for  High  Efficiency,  June  24-25,  2008,  Stanford  University,  Stanford, 
California,  USA. 


243 


N00014-07-I-1I52 


STuC5.pdf 


©  2008  OSA  /  Solar  2008 
P. I. Susan  C.  Opava,  Ph.D. 


Improvement  of  Light  Transmission  using  Photonic 

Lattices  for  Solar  Cells 
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Abstract;  \Vc  study  solar-cell  interfaces  designs  using  photonie  lattices.  We  simulate 
reetangular  and  triangular  miero-pro files  as  the  solar  eell  surfaee.  Compared  to  the 
conventional  flat  surfaee,  the  micro-profile  interface  can  increase  light  transmission  to  98%. 

OCIS  codes:  (040.6070);  (350.4238) 

1.  Introduction 

In  general,  solar  cells  arc  very  critical  for  the  energy  conversion  for  our  future  and  they  are  irreplaecablc 
energy  souree  as  well.  How  to  inerease  the  effieieney  of  a  solar  eell  is  always  an  important  researeh 
topic  up  to  now.  The  proposed  ideas  are  using  cascade  solar  eells  [1],  design  heat  cxehanger  method 
(HEM)  multi-crystallinc  solar  cells  [2,  3],  using  laser-grooved  backside  contact  [4],  simulation  results  on 
shaped  external  quantum  efficiency  (EQE)  [5],  and  simulation  on  mieromorph  solar  eell  strueture[6]. 

Modeling  of  solar  eells  plays  an  important  role  for  optimization  of  the  deviee  structure  and  the 
evaluation  of  material  parameters  and  designs.  In  the  project,  we  foeus  our  study  on  device  surfaee 
structure  design  that  will  enhance  light  extraetion  and  investigate  on  the  effects  that  influence  the  light 
power  transmission  efficiency.  We  first  study  on  applieation  of  nano-photonie  strueturc  (photonie  lattiee 
or  photonie  crystal)  in  solar  cell  design.  Further  more,  we  evaluate  and  eompare  the  various  triangular 
interface  structures,  and  optimize  the  miero-profiled  layer  design. 

2.  Photonic  Lattice  Simulation  Results  and  Discussions 

propose  to  design  a  micro-scale  photonie  grating  at  the  interfaee  of  solar  eell  to  enhanee  the  light 
transmission  in  order  to  improve  the  total  absorption  of  the  deviee,  and  perform  a  simulation  of 
dilfraetion  based  on  simplified  two-dimensional  (2D)  rigorous  eouplcd  wave  analysis  (RCWA)  to 
evaluate  the  eoneept  of  the  diffraetion  grating  application.  RCWA  is  a  rigorous  grating  diffraction  theory 
which  is  used  to  study  the  meehanism  of  the  diffraetion  of  light  from  the  periodie  structured  surfaees  [7- 
9].  RCWA  represents  the  electromagnetic  fields  as  a  sum  over  eoupled  waves.  Full  vector  Maxwell's 
equations  are  solved  in  Fourier  domain  to  obtain  eaeh  eoupled  wave,  which  is  related  to  Fourier 
haiTnonic.  Fourier  harmonics  are  used  for  the  periodie  permittivity  function  in  the  calculation.  Then  the 
diffraetion  effieiencies  are  ealeulated.  For  eaeh  ineident  angle  0,  wc  ealculatc  the  transmitted  -20  to  +20 
order  diffraction  cflleicncy.  At  the  end  of  calculation,  we  obtained  the  transmittance  by  summing  all  the 
diffraction  effieiencies. 

The  schematic  diagrams  of  the  simulation  model  which  have  three  kinds  of  interfaces  are  shown  in 
Fig.  1.  The  transmittance  diffraetion  eharaeteristies  of  the  flat  interfaee,  reetangular  photonie  lattiee 
grating,  and  triangular  photonie  lattice  gratings  are  analyzed  and  compared.  First,  we  assume  that  the 
gratings  period  A=6pm  and  the  gratings  groove  depth  d=3pm  are  same  in  Fig.  1(b)  and  (e).  While  the 
bottom  width  of  triangular  grating  is  w=3pm.  In  this  ease,  the  rectangular-profile  is  actually  a  square- 
profile.  For  simplicity  in  this  simulation,  we  consider  lossless  dielectrics  and  incident  electromagnetic 
plane  wave  polarization  perpendicular  to  the  plane  of  incidence.  The  results  of  the  three-profilc 
comparison  are  shown  in  Fig.  2(a):  the  transmittance  of  flat  surface  (straight  line),  rectangular  profile 
surfaee  (short  dashed  line),  and  triangular  profile  surface  (long  dashed  line)  as  function  of  ineident  light 
wavelength.  It  is  very  clear  that  the  triangular  photonie  lattiee  structure  has  the  highest  light 
transmittance,  which  is  about  75%-85%  distributed  across  the  wavelength  span  up  to  1 .2pm.  The  square- 
profile  photonie  lattiee  is  also  better  than  the  flat  surface  in  general.  However  its  total  transmission  is 
oscillating  versus  the  wavelength.  And  at  some  wavelength  such  as  0.6-0. 7pm,  the  transmission  rate  of 
square-profile  is  lower  than  that  of  the  flat  surfaee.  Our  simulation  shows  clearly  that  a  partial  of  blocked 
light  can  be  extracted  by  using  the  transmitted  diffraetion  of  the  miero-scale  photonic-lattiee. 
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We  also  performance  simulations  for  the  above  three  eases  at  different  incident  angles,  which  is 
shown  in  Fig.  2(b).  The  incident  angle  0  (as  shown  in  Fig.  1)  upon  the  normal  of  the  grating  from  a  plane 
wave  are  varied  from  0  to  90^^.  The  calculation  is  at  700nm  wavelength.  The  periodic  gratings  produce 
both  forward  diffracted  (transmitted  diffraction)  and  backward  diffracted  (reflected  diffraction)  waves. 
For  a  given  incident  angle  0,  the  transmittance  is  the  sum  of  the  transmitted  diffraction  efficiency  of  all 
orders,  which  enters  into  Si  through  the  gratings  from  the  air.  It  also  shows  that  the  triangular-profile 
photonic  lattice  has  the  highest  transmission  rate  at  any  launch  angle. 


Air 


Light 


SI 


Light 


‘.wywwv/u''' 

SI  -r  R 


(a)  (b)  (c) 

Fig.  1  The  schematic  diagrams  of  solar  micro-profiles  for  the  simulation,  a)  flat  interface;  b)  rectangular  interface;  and  c)  triangular 

interface 


Fig.  2  The  transmittance  of  flat  surface  (straight  line),  rectangular  profile  surface  (short  dashed  line),  and  triangular  profile  surface 
(long  dashed  line)  as  function  of  (a)  incident  light  wavelength  and  (b)  incident  light  angle. 

Since  the  triangular-profile  photonic  lattice  has  the  best  performance,  wc  vary  the  depth  d  and  width 
w  to  find  the  optimize  design  point  for  this  interface  structure.  Fig.  3  (a)  shows  the  light  transmission  of 
d=l,  2,  3,  4,  and  lOpm,  w=  3jLim,  and  A=6pm.  The  w=3jLim  and  d=2]im  case  has  the  highest  transmission 
efficiency.  Fig.  3  (b)  shows  the  light  transmission  of  d=3jLim,  w=  I,  2,  3,  4,  5,  and  6  pm,  and  A=6pm. 
The  largest  width  w=6pm  case  has  the  best  transmission.  From  above  data,  we  further  simulate  w=6pm 
case  with  d=l,  2,  3,  4,  and  10pm  (shown  in  Fig.  4(a))  and  other  w  and  d  combinations.  For  the  case 
w=6pm  and  d=10pm,  the  transmission  is  above  0.98  from  0.05  to  1.2pm  wavelength,  which  is  our  best 
result.  Its  transmission  versus  the  launch  angle  at  700nm  wavelength  is  shown  in  Fig.  4(b).  Compared  to 
the  conventional  flat  surface,  the  triangular-profile  interface  has  about  15%-30%  improvement  of  light 
transmission  coefficient,  from  70%  (flat  surface)  to  98%  (triangular  surface). 

In  conclusion,  the  simulation  gives  us  a  clear  insight  of  the  transmitted  diffraction  mechanism  for 
designing  the  optical  interface  of  solar  cells.  The  diffraction  of  a  well  designed  grating  increases  the  light 
transmission  and  allows  a  portion  of  reflected  light  (of  the  flat  interface)  to  pass  through.  If  we  further 
optimize  the  parameters  of  grating  with  different  periods  (even  to  nano-scale),  other  profiles,  and  suitable 
refractive  index  of  coating,  we  can  improve  light  extraction  efficiency  of  solar  cells.  In  this  simulation, 
we  achieve  about  98%  light  transmission  rate  compared  to  the  flat  surface. 

This  work  was  sponsored  by  the  Department  of  the  Navy,  Office  of  Naval  Research,  under  Award  # 
N00014-07-1-1152. 
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Fig.  3  The  transmittance  of  triangular-profile  interface:  (a)  d-I,  2,  3,  4,  and  10  pm,  3  pm,  and  A=6pm  and  (b)  d^3pm,  w= 

1 , 2,  3,  4,  5,  and  6  pm,  and  A=^6pm. 


Fig.  4  The  transmittance  of  (a)  triangular-profile  interface:  d  "l,  2,  3,  4,  6,  8  and  10  pm,  w=  6  pm,  and  A=6pm  and  (b)  triangular- 
profile  interface  d-10  pm,  w=  6  pm,  and  A=6pm  comparison  to  flat  interface 
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We  present  a  comprehensive  analytical  theoretical  model  for  the  relative  intensity  noise  (RIN)  spectrum 
of  integrated  semiconductor  quantum-well  (QW)  lasers  under  injection-locking.  We  use  a  novel  setup  by 
employing  an  integrated  electroabsorption  modulator-laser  (EML)  to  measure  the  RIN  of  the  injection- 
locked  distributed  feedback  (DFB)  laser,  where  the  modulator  section  is  used  as  a  photodetector.  The 
EML  has  an  anti-reflection  coating  on  the  laser  side,  so  that  an  injection  light  from  an  external  master 
laser  can  be  coupled  effectively  into  the  laser  section.  This  scheme  simplifies  the  setup  and  reduces 
the  alignment  loss  between  discrete  optical  components.  Experimental  data  indicates  that  the  injec¬ 
tion-locking  technique  can  reduce  the  RIN  noise  floor  and  increase  the  relaxation  frequency  of  the  laser. 
We  also  compare  the  RIN  spectra  of  the  free-mnning  laser  with  the  injection-locked  laser  and  show  an 
increase  of  the  relaxation  frequency  from  3.7  GHz  (free-running)  to  1 1.3  GHz  (injection-locked).  By  fitting 
the  experimental  data  using  our  model,  we  show  very  good  agreement  between  our  data  and  theory.  Our 
model  considers  the  optical  confinement  factor  of  photons  and  carriers  for  quantum-well  structure  lasers. 
We  also  improve  the  injection-locking  RIN  model  by  including  the  gain  saturation  from  the  master  laser 
noise. 

©  2008  Elsevier  Ltd.  All  rights  reserved. 


1.  Introduction 

An  injection  locked  laser  system  contains  two  semiconductor 
lasers.  The  light  from  a  master  laser  is  injected  into  the  slave  laser 
oscillating  above  threshold,  and  the  injected  radiation  competes 
with  the  spontaneous  emission  of  the  slave  laser  being  amplified. 
If  the  optical  frequency  of  the  injected  light  is  close  to  the  eigen- 
frequency  of  the  unperturbed  laser,  the  slave  laser  will  adjust  its 
frequency  and  coherence  properties  to  that  of  the  injected  light. 
When  a  complete  locked  state  is  reached,  all  of  the  power  of  the 
slave  laser  is  emitted  at  the  optical  frequency  of  the  master  laser. 
This  phenomenon  is  known  as  injection-locking.  Injection-locking 
technique  is  a  promising  candidate  for  high-bandwidth  optical 
transmitters.  For  analog  fiber  optical  communication  system,  this 
technique  is  an  effective  method  to  increase  the  laser  relaxation 
oscillation  frequency  [1-7],  improve  laser  bandwidth  [1-7],  reduce 
nonlinear  distortions  [8],  suppress  the  frequency  chirp  and  further 
reduce  the  laser  system  noise  [9-13). 

Relative  intensity  noise  (RIN)  is  a  very  important  property  for 
semiconductor  lasers  which  represents  the  laser’s  intrinsic  reso¬ 
nance.  For  optical  communication,  low  RIN  floor  is  needed  for 
the  transmitter  to  achieve  desirable  signal-to-noise  ratio  (SNR). 
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The  intensity  noise  spectrum  shows  a  peak  near  the  relaxation  fre¬ 
quency.  which  is  an  important  parameter  for  the  laser  system  and 
directly  related  to  the  bandwidth  of  the  laser.  Several  theoretical 
simulations  of  noise  characteristics  have  been  reported  [14-18) 
and  have  predicted  relaxation  frequency  enhancement  with  injec¬ 
tion-locking  [14).  However,  little  experimental  work  on  RIN  spec¬ 
tra  for  injection-locked  semiconductor  lasers  is  available  in  the 
literature  (9.13,14,19]  to  confirm  the  noise  reduction  of  injection¬ 
locking  system  directly.  This  is  due  to  high-fiber  coupling  loss, 
the  optical  signal  is  too  weak  to  allow  direct  noise  measurement 
by  the  current  testing  equipment.  In  Ref.  (13).  an  EDFA  followed 
by  an  optical  filter  were  used  to  amplify  the  noise  signal  before 
sent  into  the  lightwave  analyzer  for  detection.  This  method  actu¬ 
ally  will  add  EDFA  noise  into  the  injection-locked  laser  noise.  In 
this  paper,  we  report  RIN  experimental  results  and  theoretical  cal¬ 
culations  of  an  injection-locked  distributed  feedback  (DFB)  laser 
using  an  integrated  electroabsorption  modulator-laser  (EMLs)  or 
integrated  laser-modulators  (ILMs),  as  they  are  also  known.  An 
electroabsorption  modulator  has  commonly  been  developed 
monolithically  with  an  integrated  DFB  laser  to  eliminate  coupling 
loss  at  a  joint  [20-22).  This  device  has  a  higher  reflection  (HR)  coat¬ 
ing  on  the  modulator  side  and  an  anti-reflection  (AR)  coating  on 
the  laser  facet  (Fig.  1 ).  In  our  experiment,  we  use  the  reveres  biased 
modulator  as  a  photodetector  and  investigate  the  injection-locking 
noise  phenomena  of  the  DFB  laser.  With  the  modulators  acting  as 
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Fig.  1.  The  schematic  diagram  of  an  integrated  electroabsorption  modulator-laser. 
The  laser  facet  is  AR  coated  for  optical  output,  and  the  modulator  facet  is  HR  coated. 
Between  the  DFB  laser  and  the  modulator  is  an  electrical  isolation  section. 

photodetectors,  the  number  of  connectors  in  our  setup  is  reduced, 
the  electrical  signal  can  be  directly  measured,  and  a  more  accurate 
measurement  is  obtained.  Also,  the  results  for  injection-locked 
EMLs  give  us  an  opportunity  to  confirm  the  theories  of  increased 
relaxation  frequency  in  injection-locked  DFB  lasers  directly.  As  a 
matter  of  fact,  the  external  optical  injection  in  integrated  lasers 
is  also  a  relatively  uninvestigated  field.  Furthermore,  this  experi¬ 
mental  and  theoretical  work  also  gives  us  insight  on  the  integrated 
injection-locking  detection  system. 

Our  paper  is  organized  as  follows.  In  Section  2,  we  present  a 
comprehensive  analytical  RIN  theory  of  an  injection-locked  inte¬ 
grated  semiconductor  laser.  In  Section  3,  the  experimental  data 
and  theoretical  calculation  results  of  RIN  of  an  injection-locked  la¬ 
ser  using  an  EML  are  discussed.  Our  conclusion  is  summarized  in 
Section  4. 


(Optical  feedback  terms  by  the  EML  modulator) 
dN(t)  _  rvj  N{t) 

dt  “  qd  T„ 


-r(^Co  +  c„^)[i  -£S(t)-£MSM(t))S(f)  (3) 

In  the  rate  equations  of  photon  density  and  phase  of  the  slave  laser, 
there  are  three  catalogs  of  terms:  (1)  normal  slave  laser  terms.  We 
consider  the  additional  gain  saturation  caused  by  the  injected  light; 
(2)  additional  terms  because  of  injection- locking;  and  (3)  optical 
feedback  terms  by  the  EML  modulator  section,  according  to  the  long 
and  Kobayashi  model  (23-241.  For  the  optical  feedback  terms,  kf  is 
the  feedback  parameter.  The  t,>,  is  the  round  trip  time  in  the  laser 
cavity,  t  is  the  round  trip  time  of  the  light  in  the  modulator  section. 
In  our  experiment,  we  reversed  bias  the  modulator  section  and  it 
acts  as  an  absorption  photodetector.  It  is  known  that  when  the 
biased  electroabsorption  section  strongly  absorbs  light,  the  feedback 
is  weak  and  does  not  affect  the  locking  of  the  laser  section.  Therefore, 
in  our  final  model,  we  neglect  the  optical  feedback  terms  or  set  ky  *  0 
to  keep  the  model  as  simple  as  possible.  The  final  equations  are: 


d5(t) 

dt 


r(Go  +  G„^y-l 

+  2/c \/S(t)SM(t)  cos((^(t)  -  4>M{t)) 


S(t) 


®  ^  (1  -  eS(t)  -  £MSM(t))AN(t)  -  (w,-  -  Wo) 
-  k^S{t)/SM{t)s\n{cl>{t)  - 


(4) 

(5) 


2.  Theory  of  relative  intensity  noise  of  an  injection-locked 
integrated  semiconductor  laser 


dN(f) 

df 


^  ^  -  /'(co  +  C„  [1  -  £S(t)  -  £MS„(t)]S(t) 


(6) 


A  semiclassical  analysis  is  used  to  analyze  the  RIN  spectra  of 
semiconductor  lasers.  To  determine  the  laser  RIN,  we  must  obtain 
the  total  photon  fluctuation  in  the  cavity  A5ftj,  the  total  carrier 
fluctuation  AN(t),  and  instantaneous  frequency  deviation  ^(t)  from 
their  stationary  values.  Then  we  need  to  add  appropriate  Langevin 
noise  in  these  equations,  and  find  the  power  spectral  density  of  the 
photon  fluctuation.  The  rate  equations  for  the  slave  laser  field  are 
based  on  Ref.  [15],  and  we  modify  them  according  to  the  integrated 
semiconductor  laser,  add  nonlinear  gain  saturation  coefficients  for 
both  slave  and  master  lasers,  and  insert  the  optical  confinement 
factor  of  the  QW  laser  structure; 


dS(t) 

df 


(1  -  £5(t)  -  €M5M(t))  -  •; 


S(f) 


(Normal  slave  laser  terms) 


+2ky/S(t)SM(t)cos(<j>(t)  - 


(Injection-locking  terms  by  the  injected  laser) 

+  —S{t-z)cos(<j>(t-z)-oJo':~(t>{t))  (1) 

Tin 


(Optical  feedback  terms  by  the  EML  modulator) 
^  ^  (1  -  £S{t)  -  £MSM(t))AN{t) 


(Normal  slave  laser  terms) 

-(w,  -  Wo)  -  ky/S(t)/SM{t)  sin(0(t)  -  0„(t)) 


(Injection-locking  terms  by  the  injected  laser) 

V  sin(()!)(t  -  T)  -  ojflT  -  </>(0)  (2) 


where  S(t)  and  S/vKt)  are  the  total  photon  number  of  the  slave  laser 
and  injected  field,  (p(t)  and  (pM(t)  are  the  phase  of  the  slave  laser 
and  injected  field,  wj  and  (Uo  are  the  injected  field  frequency  and 
the  slave  laser  resonance  frequency,  k  *  c/{2ngL)  is  coupling  coeffi¬ 
cient,  c  is  the  velocity  of  light  in  the  vacuum,  L  and  are  the  length 
and  the  group  index,  respectively.  Zp  is  the  photon  lifetime,  Tn  is  the 
carrier  lifetime,  J  is  the  current  density,  q  is  the  unit  charge,  d  is  the 
active  region  thickness,  n(t)  is  the  carrier  density,  ot  is  the  linewidth- 
enhancement  factor,  and  F  is  the  optical  confinement  factor  of  the 
QW  laser  structure  [25].  In  QW  lasers,  the  carriers  and  photons  occu¬ 
py  different  volumes.  The  total  number  of  photons  in  the  slave  laser 
is  S(t)  -  So  +  AS(t)  -  V|E(t)p,  while  E(f)  is  the  optical  field.  The  total 
number  of  carriers  is  N(f)  *  FV  n(f).  V  is  the  optical  mode  volume. 
The  optical  confinement  factor  is  well-known  to  be  important  for 
separate  confinement  quantum-well  structures;  however,  it  is  usu¬ 
ally  ignored  in  literature  on  injection-locking.  Go  is  the  cavity  gain 
coefficient,  and  Gn  =  dG/dn]n .  no  is  the  differential  gain.  The  gain  sat¬ 
uration  is  also  included,  where  e  and  are  the  nonlinear  gain  satu¬ 
ration  coefficients  corresponding  to  the  slave  laser  signal  and  the 
injected  signal.  The  nonlinear  gain  saturation  coefficients  have  been 
used  in  earlier  studies  [26-28]  on  high-speed  lasers  where  the  gain 
of  the  slave  laser  light  is  suppressed  due  to  the  presence  of  the  in¬ 
jected  light.  Ref.  [26]  employs  two  saturation  terms  because  the  in¬ 
jected  light  and  the  internal  light  have  orthogonal  polarizations.  In 
our  derivation,  the  injected  light  is  slighted  different  from  the  slave 
light.  They  both  have  contribution  to  the  slave  laser  gain  saturation, 
which  is  also  called  the  cross-gain  saturation  of  laser  amplifiers 
[29,30].  Therefore,  in  our  simulation,  we  need  to  consider  both  ef¬ 
fects  and  use  £m  e.  This  is  an  important  phenomenon  if  we  inject 
light  in  the  laser  gain  region  and  it  cannot  be  neglected.  Actually, 
inclusion  of  F  and  Sm  is  important  to  obtain  consistent  parameters 
for  the  gain  and  differential  gain  for  quantum-well  lasers.  Finally, 
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the  above  equations  show  that  the  slave  laser  will  be  affected  by  the 
emission  of  the  master  laser.  When  a  photon  is  spontaneously  emit¬ 
ted  in  the  master  laser,  it  will  cause  deviations  of  the  amplitudes  and 
phases  of  the  slave  and  master  laser  fields  from  their  stationary  val¬ 
ues.  Thus,  we  must  consider  the  master  laser  noise  characteristics 
when  deriving  the  RIN  of  the  slave  laser. 

Noise  caused  by  spontaneous  emission  and  carrier  generation- 
recombination  is  included  in  the  rate  equations  by  adding  the 
appropriate  Larigevin  driving  terms.  For  simplicity,  we  also  assume 
that  the  Langevin  noise  sources  of  the  slave  laser  are  independent 
of  the  Langevin  noises  of  the  master  laser.  The  two  sets  of  noise 
sources  are  uncorrelated.  Neglecting  the  higher  order  terms,  the 
differential  forms  of  the  rate  equations  for  the  injection-locked  la¬ 
ser  system  with  Langevin  noise  terms  (Fas(0.  FanCO)  ^nd 

master  laser  ncises  (ASM(t).  A</>M(t))  are 


AS(t)- 


rGo(i 
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AS{f) 


'  V 

+  (kfSo/SMo 


r5o  CM5Mo)AN(f) 
-  I  Co/^M5o)ASM(f) 
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-  2ksSoA(j)M{t)  +  FAs(f)  (7) 
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^  r.MrCfoSoASM{t)  F\s(t)  (9) 

where 

kc  =  ky/SMo/^o  ^os(<f>Q  —  (Pmq) 
ks  =  k\/SMo/So  sin(<^o  “  <^mo) 

We  define  AS((fj).  A  AN((o),  ASm(oj).  A0n,((o).  F^oj),  Facp(oj), 
and  Fa/v(^^7)  the  Fourier  transforms  of  the  truncated  functions  cor¬ 
responding  to  A5(t),  A  AN(t),  ASM(t),  A(/7M(t),  F^t),  F^Jt),  and 
Fan(0>  Using  the  Fourier  transforms  of  Eqs.  (7)-(9).  and  gain-loss 
relation  derived  from  the  steady-state  solution  of  Eq.  (4), 
2kc  =  2ky/SoSMo cos((f>o  -  (f>Mo)  =  -rCo(l  -rSo  -  ^mSmo)  +  we  ob¬ 
tain  the  followirg  linear  algebraic  equations. 
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(11) 


The  power  spectral  density  of  the  slave  laser  photon  can  be  ob¬ 
tained  using  the  truncated  function  and  Fourier  analysis  techniques 
[17].  Then,  the  RIN  of  the  slave  laser  is  obtained  as 


2  I  RsG^„S^n 
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where  Re|...]  stands  for  "the  real  part  of  [.  .]”. 
"/p  =  ^  +  Cn(l  —f'So  —  Fm5mo)5o/V  which  is  determined  by  the  car¬ 
rier  lifetime,  the  slave  photon  number,  and  the  cavity  gain, 
Vk  -  ksOL  which  is  related  to  the  phase  difference  and  detuning 
between  the  slave  and  master  lasers,  and 
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In  the  equations  above,  PMM(f^7),  PASMA4»M(f^^)*  Pa<Pm(oj),  and 
pAtf>MASM(t^)  power  spectra  of  the  free-running  master  laser, 

which  can  be  obtained  by  setting  SM(t)*0  in  Eqs.  (4)-(6).  [V(ro)|^ 
is  the  denominator  of  the  RIN  of  the  slave  laser 
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The  relaxation  frequency  of  the  slave  laser  is 
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The  damping  factor  of  the  injection-locked  laser  is 


)' =  rGo{2£So  -  1) +^(1  -  eSo) +  ^ 

V  Zn  Zp 


+  Cm^mo  I 


=  y/tve  +  ^M^MO  - ^ 


(21) 


where  terms  of  a  higher  order,  or  eSoCstSwo,  have  been  ne¬ 
glected.  cOrfree  and  )’/ree  are  the  relaxation  frequency  and  the  damp¬ 
ing  factor  of  the  free-running  laser,  respectively.  The  nonlinear  gain 
saturation  term  due  to  the  master  laser,  which  represents  the  gain 
change  caused  by  the  master  laser  injection,  modifies  the  damping 
factor  of  the  laser  system. 

For  a  free-running  laser,  there  are  no  injected-photon  Sfi/t)  =  0 
or  Smo  *  0  and  ~  fCo.  Thus,  kc^ks^  yk  *  0.  We  input  those  values 
into  Eqs.  (4)-(6)  and  obtain  the  RIN,  the  relaxation  frequency,  and 
the  damping  factor  of  a  free-running  laser. 

RIN  2R,  +  (2So  +  1  j,,,  +  co^)] 

^0  +  y]ree(<^] 

(22) 

where  =  GnSo(l  -  f-So)/V.  The  relaxation  frequency  of  the 
free-running  laser  is 

=  1  rCo(2ESo  -  1 )  +  ^CoSo(l  -  eSo)  +  ^  (23) 

Zn  ZpV  ZpZn 

The  damping  factor  of  the  free-running  laser  is 

7^„  =  ^Go(2^So-l)  +  ^(l -8So)+^  +  f  (24) 

V  Zn  Zp 


Wavelength  (nm) 


Compared  with  a  free-running  laser,  the  injection-locked  laser  is  a 
third-order  system  instead  of  a  second-order  system  (free-running), 
as  shown  by  Eqs.  (18)  and  (21).  The  injected-photon  modifies  the 
slave  laser  cavity  properties,  such  as  cavity  gain  decrease,  relaxation 
frequency  increase,  and  damping  factor  variation. 

3.  Study  injection-locking  using  integrated  electroabsorption 
modulator-lasers 

3.1.  Integrated  electroabsorption  modulator-lasers  and  their  static 
characteristics 

The  structure  of  the  integrated  electroabsorption  modulator- 
laser  used  is  shown  in  Fig.  1.  The  device  has  three  sections,  which 
are  a  distributed  feedback  (DFB)  laser  section,  an  electroabsorp¬ 
tion  modulator  section,  and  an  electrode  isolation  section.  The 
length  of  the  DFB  section  is  300  pm,  the  isolation  region  is 
83  pm,  and  the  modulator  section  is  250  pm.  The  section  between 
the  laser  and  the  modulator  provides  electrical  isolation  in  the 
design. 

The  light-current  (L-/)  curves  for  this  integrated  electroabsorp¬ 
tion  modulator-laser  were  measured  as  function  of  modulator 
voltage  and  they  are  shown  in  Fig.  2a.  The  power  output  is  always 
measured  from  the  AR-coated  facet.  The  optical  spectra  of  the  EML 
at  30  mA  current  bias  and  different  modulator  voltage  biases  are 
shown  in  Fig.  2b.  The  wavelength  versus  the  current  bias  of  the 
DFB  laser  and  voltage  bias  of  the  modulator  is  summarized  in 
Fig.  2c.  The  optical  output  power  from  the  laser  is  not  influenced 
much  by  the  modulator  bias.  There  is  also  no  mode-hopping  for 
this  device  when  changing  the  voltage  bias.  When  the  modulator 
is  reverse-biased,  the  absorption  in  the  modulator  section  in¬ 
creases  due  to  Franz-Keldysh  or  quantum-confined  Stark  effects. 


Modulator  section  bias  (V) 

Fig.  2.  (a)  The  light  output  versus  the  DFB  laser  bias  current,  (b)  optical  spectra  at 
three  modulator  bias,  and  (c)  the  DFB  laser  wavelength  at  four  bias  current  (/  -  20, 
30,  40.  and  50  mA)  as  a  function  of  the  modulator  bias  voltage  for  the  integrated 
electroabsorption  modulator-laser. 


When  the  modulator  is  forward -biased,  the  gain  in  the  modulator 
section  increases  due  to  the  carrier  injection  [32].  If  looking  into 
the  modulator  section  from  the  isolation  section,  the  modulator 
section  can  be  viewed  as  an  effective  reflection  coefficient  and 
phase  for  the  optical  field  at  that  boundary,  which  can  perturb 
the  longitudinal  photon  density  profile  of  the  laser  cavity  and 
modify  the  cavity  properties.  For  our  device,  the  waveguide  in 
the  laser  section  is  straight,  and  the  constant  pitch  of  the  laser  al¬ 
ready  defines  a  specific  Bragg  wavelength  and  lasing  wavelength. 
Thus  the  influence  of  the  modulator  section  on  the  DFB  laser  wave- 
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length  is  mainly  a  small  wavelength  shift  and  not  mode-hopping 
[32]. 

3.2.  RIN  of  injection-locked  integrated  electroabsorption  modulator- 
lasers 

In  this  section,  we  present  the  experimental  results  of  external 
injections  in  an  integrated  electroabsorption  modulator-laser, 
using  the  modulator  section  of  the  EML  as  a  photodetector.  This 
experiment  utilizes  the  advantage  of  photonic  integrated  circuit 
(PIC)  technique  to  eliminate  the  disadvantages  of  using  a  more 
complicated  setup  with  a  separate  photodetector  as  presented  in 
|9|.  The  experimental  setup  is  shown  in  Fig.  3.  The  injection  signal 
from  a  single-mode  DFB  master  laser  passes  through  an  erbium- 
doped  fiber  optical  amplifier  (FDFA).  A  tunable  3-nm  bandwidth 
optical  filter  is  used  to  remove  excess  signals  on  the  side  modes. 
The  injection  level  is  monitored  by  an  optical  power  meter  before 
it  is  injected  into  the  FML  where  the  laser  section  acts  as  a  slave 
laser.  The  optical  signal  is  converted  to  an  electrical  signal  using 
the  modulator  photocurrent,  amplified  by  an  18-dB  gain  micro- 
wave  amplifier,  and  measured  by  the  electrical  spectrum  analyzer 
to  obtain  the  RIN  spectra  of  the  locked  laser  section  output.  A  T- 
Bias  is  used  to  apply  dc  voltage  onto  the  modulator  section.  In 
our  setup,  the  method  of  external  injection  is  similar  to  typical 
injection-locking  with  discrete  semiconductor  lasers.  The 
difference  arises  in  the  method  of  photo-detection  of  the  slave 
laser  output  for  electrical  analysis.  In  this  case,  the  photodetection 
occurs  in  the  modulator  section  instead  of  using  another  high¬ 
speed  photodetector. 

The  influence  of  the  modulator  bias  on  the  DFB  laser  should  be 
very  small  so  that  any  bias  change  or  fluctuation  in  the  modulator 
will  not  change  the  detuning  between  the  master  laser  and  the  DFB 
laser  on  the  FMLs,  thus  varying  the  injection  condition  and  causing 
the  laser  system  to  become  unlocked.  When  we  bias  the  DFB  laser 
of  the  FML  at  30  mA,  the  wavelength  difference  between  0  V  and 
IV  modulator  voltage  is  only  0.006  nm  or  0.75  GHz  (see 
Fig.  2c).  This  small  difference  will  not  switch  the  laser  from  the 
locked  to  the  unlocked  state,  which  ensures  that  the  photocurrent 
generation  is  relatively  independent  at  this  voltage  range.  But  the 
wavelength  diflerence  between  OV  and  -2V  is  0.04  nm  (5  GHz). 
This  wavelength  change  cannot  be  neglected.  Therefore,  in  our 
experiment  we  only  bias  our  modulator  at  OV  and  -1  V.  Fig.  2c 
also  shows  that  0  V  bias  occurs  at  the  zero  slope  or  near  zero  deriv¬ 
ative  of  the  wavelength-voltage  curve,  which  is  an  ideal  bias  point 
to  measure  the  photocurrent  spectra. 


Wavelength  (nm) 

Fig.  4.  Optical  spectra  of  the  external  master  (injection)  laser,  the  integrated  EML 
without  injection  (free-running  slave  laser),  and  the  injection-locked  EML  under 
external  injection  light  in  the  injection-locking  experiment.  The  DFB  laser  of  the 
EML  (slave  laser)  is  biased  at  30  mA,  and  the  modulator  is  biased  at  0  V. 

The  optical  spectra  of  the  injection-locking  experiment  using 
the  FML  are  shown  in  Fig.  4.  With  the  master  laser  turned  off 
and  the  DFB  slave  laser  of  the  FML  biased  above  threshold,  there 
is  no  external  injection,  and  the  slave  laser  is  free-running.  During 
the  experiment,  the  modulator  is  biased  at  OV.  The  free-running 
slave  laser  is  lasing  at  1544.1  nm  (30  mA  bias)  with  a  side-mode 
suppression  ratio  (SMSR)  of  44  dB.  The  master  laser  lases  at 
1544.2  nm  with  50  dB  SMSR.  The  detuning  between  the  two  lasers 
is  12.6  GHz.  The  injection-locked  laser  has  the  same  lasing  wave¬ 
length  as  the  master  laser  and  50  dB  SMSR.  Thus,  the  injection  light 
has  caused  the  slave  laser  to  lase  at  the  master  laser  wavelength, 
resulting  in  an  injection-locked  condition.  The  RIN  data  of  the 
injection-locked  DFB  laser  is  shown  in  Fig.  5a.  From  these  measure¬ 
ments,  we  observe  that  the  RIN  peak  shifts  in  frequency  and  ampli¬ 
tude  varies  as  a  function  of  the  injection  intensity.  The  data  are 
limited  by  the  noise  floor  of  the  electrical  spectrum  analyzer, 
which  are  around  -130dB/Hz  for  low  frequency  range  (between 
21  MHz  and  6.26  GHz)  and  -126dB/Hz  for  high  frequency  range 
(between  6.26  GHz  and  12  GHz).  We  cannot  resolve  the  signal  be¬ 
low  this  level.  But  we  can  still  observe  the  reduction  of  the  RIN 
floor  level  under  external  injection.  The  spectra  with  higher  injec¬ 
tion  power  under  injection-locking  condition  are  below  the  noise 
limit  of  the  spectrum  analyzer  and  lower  than  the  free-running 
slave  laser  (-126dB/Hz)  at  low  frequency  range.  The  relaxation 
frequency  peak  is  around  3.7  GHz  for  the  free-running  laser.  The 


Fig.  3.  Experimental  setup  of  RIN  measurement  of  the  injecting-locked  DFB  laser  using  the  integrated  electroabsorption  modulator-laser.  The  pump  light  from  the  master 
laser  is  injected  into  the  AR  facet  of  the  integrated  EML  and  the  modulator  is  used  as  a  photodetector. 
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Fig.  5.  (a)  Experimental  data  and  (b)  theoretical  calculation  of  RIN  spectra  of  an 
injection-locked  DFB  laser  system. 


maximum  observed  relaxation  frequency  is  11.3  GHz,  which  is 
three  times  the  free-running  value.  As  the  injection  intensity  is  in¬ 
creased  further,  the  RIN  peak  attenuates  and  drops  below  the  noise 
level.  Our  theoretical  results  are  shown  in  Fig.  5b,  which  agree  with 
our  experimental  data.  The  theory  clearly  shows  higher  injection 
level  results  in  a  lower  noise  floor  and  a  larger  relaxation  fre¬ 
quency.  The  values  of  the  physical  parameters  are  r  =  0.15, 
Tp»8.5ps,  V=3.89  X  10  ^°cm^  Go  *  8.7  x  lO"  s-\  Gn  =  2.3  x 
10~^cm^s  \  Tn*0.13  ns,  a*  1.8,  k*c/(2n^L)»  1.5  x  10^^  s~\  L  = 
300  pm,  Rs  “  2  X  10^^  s  and  Ug*  3.33.  The  other  important  laser 
model  parameters  are  listed  in  the  Table  1.  In  our  calculation,  some 
of  the  parameters  such  as  the  effective  index  of  refraction,  intrinsic 
loss,  and  the  initial  value  of  the  differential  gain  are  obtained  from 
independent  measurements  using  the  methods  proposed  in  Ref. 
[25).  The  linewidth-enhancement  factor  was  obtained  by  measur¬ 
ing  the  injection-locking  range  [34].  The  final  value  of  the  differen¬ 
tial  gain  and  gain  saturation  coefficients  are  fitting  parameters.  To 
simplify  the  calculation,  because  the  wavelength  of  the  injected 
signal  and  the  slave  signal  are  very  close,  we  use  Em  ^  £.  The  relax¬ 
ation  frequency  versus  injection  power  is  plotted  in  Fig.  6.  The 
symbols  are  experimental  data,  and  the  line  represents  theoretical 
results.  We  use  a  linear  relation  Pjn(mW)  *  0.03 IS^o  to  convert  the 
calculated  injected-photon  number  into  the  injection  power  to 
compare  with  the  experimental  data.  We  also  measure  the  RIN  at 
-IV  modulator  bias,  and  the  results  overlap  with  our  0  V  data  as 
expected.  This  confirms  that  the  modulator  bias  has  minimal  influ¬ 
ence  on  the  DFB  laser  section.  The  modulator  acts  as  a  photodetec¬ 
tor  in  our  experiment  to  obtain  the  RIN  of  the  injection-locked 
laser  section,  which  is  much  simpler  and  easier  than  using  discrete 
devices  [9]. 


Table  1 

The  laser  modeling  parameters. 


Parameter 

Symbols 

Value 

Cavity  length 

L 

300  pm 

Active  volume 

V 

3.89  X  10  ^®cm^ 

Effective  index  of  refraction 

"s 

3.33 

Group  velocity 

9.0  X  lO^cms  ' 

Mirror  loss 

xm 

42.15  cm  ' 

Intrinsic  loss 

oti 

23  cm  ' 

Optical  confinement  factor 

r 

0.15 

Linewidth-enhancement  factor 

y. 

1.8 

Photon  lifetime 

8.5  ps 

Carrier  lifetime 

Tn 

0.13  ns 

Differential  gain 

g'l^g'u 

3.6  X  10  '®cm2 

Nonlinear  gain  saturation  coefficient 

2.32  X  10  ’’cm^ 

Fig.  6.  The  relaxation  frequency  versus  different  injection  power  of  the  injection- 
locked  laser  system.  The  injection  power  is  monitored  by  an  optical  power  meter 
before  it  is  injected  into  the  EML  in  the  experiment.  In  the  theory,  a  linear  relation 
P,„(mVV)  -  0.031  Smo  is  used  to  convert  the  calculated  injected-photon  number  into 
the  injection  power. 


Our  results  also  show  theoretically  that  the  coherent  addition  of 
the  injected  optical  field  to  the  slave  laser  optical  field  in  the  slave 
laser  cavity  is  the  main  reason  for  the  improvement  of  relaxation 
frequency.  Without  any  injected  signal  S/^t)  -  0,  the  rate  equations 
of  the  slave  laser  amplitude  and  phase  are  uncoupled  (see  Eqs.  (4) 
and  (5)).  Also  the  phase  term  is  not  necessary  to  solve  for  the  total 
photon  spectrum.  In  an  injection-locked  laser  system,  the  injected- 
photon  term  connects  the  amplitude  and  phase  of  the  slave  laser. 
The  additional  terms  in  the  relaxation  frequency  of  the  injection- 
locked  laser  system  come  from  the  phase-amplitude  coupling. 
Our  theory  also  shows  that  the  enhancement  of  the  relaxation  fre¬ 
quency  can  be  attributed  to  the  intensity  of  the  injected  field  and 
the  gain  change  (caused  by  nonlinear  gain  saturation  terms).  Gen¬ 
erally,  any  change  in  the  injection  power  or  the  gain  will  alter  the 
relaxation  resonance  frequency  [31].  Furthermore,  an  important 
effect  of  external  optical  injection  in  the  stable  locking  regime  is 
reduction  of  the  cavity  gain  due  to  a  reduction  in  carrier  density, 
which  shifts  the  optical  resonance  frequency  and  eventually  mod¬ 
ifies  the  relaxation  frequency  [7,31,33].  Note  that  our  model  also 
includes  the  optical  confinement  factor  of  the  separate  confine¬ 
ment  heterostructure  QW  laser  and  gain  saturation  from  the  in¬ 
jected  signal  compared  to  the  other  RIN  models,  which  are 
important  to  obtain  a  reasonable  value  of  differential  gain. 

Finally,  our  data  clearly  show  that  as  long  as  we  keep  the  mod¬ 
ulator  section  slightly  revised  biased,  the  modulator  section  of  EML 
can  be  acted  as  an  independent  detector,  which  has  little  feedback 
to  change  the  injection-locking  in  the  laser  section.  This  is  the  first 
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Step  to  study  an  integrated  injection-locking  detection  system.  And 
our  data  approves  it  is  achievable.  Since  the  EML  used  is  an  al- 
ready-to-use  and  easy-to-obtain  device,  it  is  our  first  choice  for 
the  experimental  study  of  injection-locking  in  the  integration  de¬ 
vice.  In  the  future,  it  is  very  meaningful  to  solve  Eqs  ( 1  )-(3)  and  ob¬ 
tain  complete  injection-locking  model  in  the  integrate  devices  to 
reveal  the  feedback  effects. 

4.  Conclusions 

In  this  paper,  we  have  shown  experimentally  and  theoretically 
that  the  injection-locking  technique  can  improve  the  relaxation  fre¬ 
quency  of  the  slave  laser,  as  well  as  lower  the  RIN  floor  level.  In  our 
experiment,  we  use  an  integrated  electroabsorption  modulator-la¬ 
ser,  which  simplifies  the  experimental  setup  and  reduce  loss  in  data 
acquisition.  The  static  properties  of  the  used  EML  are  described, 
including  its  physical  structure  and  operation.  The  experimental  re¬ 
sults  of  the  external  injection  in  EMLs  are  shown,  emphasizing  a  no¬ 
vel  method  of  obtaining  the  electrical  spectra  of  the  output  light  by 
directly  measuring  the  output  photocurrent  of  the  EML  modulator 
section.  This  differs  from  all  previous  external  injection  experi¬ 
ments,  which  use  a  separate  photodetector  to  produce  the  modu¬ 
lated  photocurrent.  In  summary,  besides  present  a  comprehensive 
analytical  theoretical  model  for  the  relative  intensity  noise  (RIN) 
spectrum  of  integrated  semiconductor  quantum-well  (QW)  lasers 
under  injection-locking,  we  also  explore  the  possibility  of  the  injec¬ 
tion-locking  photonic  integrated  circuit  (PIC)  technique. 

Acknowledgments 

We  thank  Ccl  Poly  C3RP  2005  and  2007  grant  (The  Department 
of  the  Navy,  Office  of  Naval  Research,  under  Award  #  ONR  N00014- 
05-1-0855  and  ONR  N00014-07-1-1 152)  and  Agilent  Global  Re¬ 
search  Funding  2006  and  2007  (Contract  #  07-040  and  08-146) 
for  the  support  of  this  research. 


References 

(11  Lidoyne  0.  Gallion  PB.  Erasme  D.  lEEEJ  Quant  Electron  1991;27:344. 

12]  Chen  HF.  Liu  JM.  Simpson  TB.  Opt  Commun  2000;173;349. 

(3)  Simpson  TB.  Liu  JM.  IEEE  Photon  Technol  Lett  1997:9:1322. 

[4]  Wang  J.  Haidar  MK.  Lin  L,  Mendis  FVC.  IEEE  Photon  Technol  Lett  1996:8:34. 
IS]  Meng  XJ.  Chau  T.  Wu  MC.  Electron  Lett  1998:34:2031. 

[6]  Haidar  MK.  Coetzee  JC.  Gan  KB.  IEEE  J  Quant  Electron  2005:41:280. 

[7]  Jin  X.  Chuang  5L  Solid-State  Electron  2006:50:1 141. 

[8]  Lang  R.  IEEE  J  Quant  Electron  1 982 :QE- 18:976. 

19]  Jin  X.  Chuang  SL  Appl  Phys  Lett  2000:77:1250. 

[10]  Yabre  G.  J  Lightwave  Technol  1996:14:2367. 

[11  (  Harb  CC.  Ralph  TC.  Huntington  EH.  Fretiage  I.  McClelland  DE.  Bachor  H.  Phys 
Rev  A  1996:54:4370. 

112(  Huntington  EH.  Buchler  BC.  Harb  CC.  Ralph  TC.  McClelland  DE.  Bachor  H.  Opt 
Commun  1998:145:359. 

[13(  Chrostowski  L,  Zhao  X.  Chang-Hasnain  CJ.  IEEE  T  Microw  Theory 
2006: 54(2): 7 88. 

[14]  Simpson  TB.  Liu  JM.  Gavrielides.  IEEE  Photon  Technol  Lett  1995:7:709. 

[15]  Espana-Boquera  MC.  Puerta-Notario  A.  Electron  Lett  1996:32:818. 

[16]  Yabre  G.  Wardt  HD.  Van  den  Boom  HPA.  Khoe  GD.  IEEE  J  Quant  Electron 
2000:36:385. 

[17]  Spjno  P,  Piazzolis  S,  Tamburrini  M.  lEEEJ  Quant  Electron  1986;QE-22:427. 
[18(  Schunk  N.  Petermann  K.  lEEEJ  Quant  Electron  l986:QE-22:642. 

[19]  Hong  Y.  Shore  KA.  lEEEJ  Quant  Electron  1999:35:1713. 

[20]  Tanbun-Ek  T.  Adams  L,  Nykolak  G.  Bethea  C.  People  R.  Sergent  A.  Wisk  P, 
Sciortino  P.  Chu  5.  Fullowan  T.  Tsang  WT.  IEEE  J  5el  Top  Quant  Electron 
1997:3:960. 

[21]  Bigan  E.  Ougazzaden  A.  Huet  F.  Carre  M.  Carenco  A.  Mircea  A.  Electron  Lett 
1991:27:1607. 

[22]  Wakita  K.  Kotaka  I.  Mitomi  O.  Asai  H.  Kawamura  Y.  IEEE  Photon  Technol  Lett 
1991:3:138. 

[23]  Ung  R.  Kobyashi  K.  lEEEJ  Quant  Electron  1980:QE- 16:347. 

[24]  MasoIIer  C.  IEEE  J  Quant  Electron  1997:33:796. 

[25]  Minch  J.  Park  5H.  Keating  T.  Chuang  5L  lEEEJ  Quant  Electron  1999:35:1526. 

[26]  Eom  J.  Su  CB.  Appl  Phys  Lett  1989:54:1734. 

]27]  Unge  CH.  Su  CB.  Appl  Phys  Lett  1989:55:1704. 

(281  Vassilovski  D.  Wu  TC.  Kan  S.  Lau  KY.  Zah  CE.  IEEE  Photon  Technol  Lett 
1995:7:706. 

[291  Jin  X.  Keating  T.  Chuang  5L  IEEE  J  Quant  Electron  2000:36:1485. 

[3oj  Qasaimeh  0.  J  Lightwave  Technol  2008:26:449. 

[31 1  Lin  L  lEEEJ  Quant  Electron  1994:30:1701. 

[321  Hsu  A.  Chuang  5L,  Fang  W.  Adams  U  Nykolak  G.  Tanbun-Ek  T.  IEEE  J  Quant 
Electron  1999:35:961. 

[331  Simpson  TB.  Liu  JM.  Gavrielides  A.  lEEEJ  Quant  Electron  1999:35:961. 

(341  Liu  G.  Jin  X.  Chuang  5L  IEEE  Photon  Technol  Lett  2001:13:430. 


254 


N000I4-07-I-1152 


P.l. Susan  C.  Opava,  Ph.D. 


11.  Current  Work: 

We  are  still  working  on  combine  top  and  bottom  grating  design:  Simeon  Trieu,  Xiaomin 
Jin,  Bei  Zhang,  Tao  Dai,  Wei  Wei,  Chang  Xiong,  Xiang-Ning  Kang,  and  Guo-Yi  Zhang,  "Study 
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Project  Report:  Algae  Lipid  Characterization  and  Extraction 
Research  Background 

As  the  use  of  biofuels  expands  in  the  United  States,  it  has  become  apparent  that  conventional 
feedstocks  such  as  soybean  oil,  palm  oil  and  waste  vegetable  oil  are  not  sufficient  to  meet 
biodiesel  demand.  It  has  been  suggested  by  the  U.S.  National  Renewable  Energy  Laboratory 
(NREL)  that  algae  have  potential  as  a  feedstock  for  the  large-scale  production  of  biodiesel. 
Previous  research  has  concluded  that  algae  may  be  up  to  30  times  as  productive  a  biodiesel 
feedstock  per  unit  area  than  conventional  terrestrial  crops  (Sheehan  et  al.,  1998).  Although  the 
high  costs  of  conventional  algae  production  exclude  the  possibility  a  of  cost-effective  large-scale 
algae  biodiesel  process,  the  integration  of  algae  production  into  a  separate  process  may  open  up 
new  possibilities.  NREL  has  proposed  that  algal  wastewater  treatment  might  be  effectively 
combined  with  algae  biodiesel  production.  Extraction  of  triglycerides  from  wastewater-grown 
algae  may  yield  a  crude  oil  that  can  be  processed  to  produce  biodiesel.  The  Defense  Advanced 
Research  Projects  Agency  (DARPA)  is  also  interested  in  the  investigation  of  such  a  process  for 
the  purpose  of  producing  a  suitable  replacement  for  the  JP-8  fuel  used  extensively  by  the  U.S. 
Military.  JP-8  is  chemically  similar  to  diesel  fuel  and  is  used  by  the  military  in  diesel  engines. 

Research  conducted  throughout  the  1950s  by  E.  G.  Bligh  and  W.  J.  Dyer  of  the  Fisheries 
Research  Board  of  Canada  led  to  the  1959  publication  of  a  method  for  the  rapid  extraction  of 
lipids  from  fish  material.  Lipids  are  a  class  of  biomolecules  which  include  triglycerides.  The 
“Bligh  and  Dyer”  method  of  lipid  extraction  has  been  refined  through  other  studies  since  its 
initial  publication.  Professor  Elahe  Ennsani  of  San  Francisco  State  University  described  a 
modified  version  of  the  Bligh  and  Dyer  procedure  specifically  for  lipid  extractions  from  algae  in 
her  1990  Ph.D.  Thesis.  The  modified  Bligh  and  Dyer  method  has  excellent  lipid  recovery 
efficiency,  but  the  industrialization  of  the  process  poses  several  problems.  The  procedure 
requires  a  very  large  solvent  to  biomass  (vol/vol)  ratio,  uses  highly  toxic  solvents  which  limit  the 
usefulness  of  residual  algae  solids  as  a  fertilizer,  involves  a  complex  choreography  of  steps 
which  does  not  lend  itself  to  automation,  and  requires  a  high  energy  input  for  solvent  recovery. 

The  objectives  of  the  current  research  are  to  develop  methods  of  producing  algae  with  high 
triglyceride  content  and  to  establish  whether  the  lipids  produced  by  such  algae  are  suitable  for 
conversion  into  a  biodiesel  fuel.  The  research  is  also  meant  to  work  toward  cost-effective  and 
safe  methods  of  extracting  biodiesel-appropriate  triglycerides  from  algal  growth  media.  The 
main  determinants  of  fuel  suitability  are  the  carbon  chain  length  and  level  of  hydrogen  saturation 
of  the  aliphatic  regions  of  triglycerides. 
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Materials  and  Methods 

Algae  Ponds 

The  algae  used  for  experimentation  have  been  grown  in  an  experimental  pilot  algae  treatment 
system  at  the  San  Luis  Obispo  Water  Reclamation  Facility.  Algae  have  been  harvested  from 
ponds  in  the  pilot  system  throughout  the  research.  The  ponds  are  exposed  to  the  elements  and 
continuously  supplied  with  primary  wastewater  effluent  from  the  City  of  San  Luis  Obispo,  just 
as  an  industrial  production  facility  might  be. 

The  algae  ponds  at  the  wastewater  treatment  plant  have  been  operated  in  two  different 
arrangements  during  the  course  of  experimentation:  continuous  mode  and  batch  mode.  In 
continuous  mode,  primary  wastewater  effluent  is  constantly  discharged  into  the  ponds  and  algae 
water  is  constantly  removed  from  the  ponds  at  the  same  rate.  When  operated  in  continuous 
mode,  the  ponds  have  a  hydraulic  residence  time  of  approximately  5  days.  Continuous  mode 
operation  is  likely  to  be  the  most  practical  arrangement  for  large-scale  algae  production; 
however,  algae  which  have  had  longer  than  5  days  to  grow  tend  to  produce  a  higher 
concentration  of  lipids.  A  highly  dense  algae  culture  with  high  lipid  concentration  is  ideal  for 
laboratory  investigation  because  the  greater  mass  of  test  material  allows  a  higher  sensitivity  in 
resulting  data. 

An  extremely  long  residence  time  can  be  achieved  by  growing  algae  in  batch  mode.  In  batch 
operation,  a  reactor  is  filled  with  wastewater,  inoculated  with  algae,  and  then  left  to  grow.  This 
method  also  makes  it  possible  to  evaluate  the  quantity  and  types  of  lipids  produced  throughout 
the  lifespan  of  an  algal  culture,  which  is  difficult  to  ascertain  from  a  continuous  culture.  Batch 
culture  experiments  have  been  conducted  in  the  current  research  with  residence  times  of  up  to  25 
days.  The  high  concentrations  of  lipids  produced  by  batch  culture  algae  are  ideal  for  research 
because  they  improve  the  accuracy  of  chromatographic  analysis. 

Sampling 

Harvesting  techniques  were  developed  for  the  accurate  determination  of  lipid  content  and  quality 
in  algae  samples  from  the  ponds.  Initial  samples  were  processed  by  using  an  alum  coagulant, 
Al2(S04)3°l  8  H2O,  followed  by  centrifugation  in  a  4-liter  capacity  floor  centrifuge.  Although  it 
was  established  that  alum  does  not  interfere  with  chromatographic  analysis,  this  process  was 
later  amended  due  to  uncertainties  about  the  water  content  of  the  algae  being  processed. 
Specifically,  the  volumetric  change  of  the  sample  associated  with  alum  flocculation  and  the 
water  content  gradient  which  occurs  in  a  sample  processed  in  a  large  centrifuge  bucket  made  it 
difficult  to  accurately  assess  the  algae  content  and  the  alum  content  of  the  samples  to  be 
analyzed.  Although  flocculation  and  centrifugation  may  be  an  effective  method  of  algae 
collection  in  an  industrial  process,  the  remainder  of  the  research  has  been  conducted  with  algae 
samples  concentrated  by  centrifugation  alone,  using  a  table  top  centrifuge.  This  method  results 
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in  concentrated  algae  samples  of  approximately  constant  water  content,  which  is  necessary  in 
order  to  maintain  the  level  of  accuracy  required  in  a  laboratory  setting. 

Some  samples  of  algae  were  frozen  prior  to  centrifugation  to  establish  whether  freezing  is  an 
effective  method  of  sample  preservation.  The  samples  were  later  thawed  and  it  was  observed 
that  most  of  the  algal  solids  had  settled.  This  illustrated  that  freezing  prior  to  centrifugation 
eliminates  the  possibility  of  subsequent  analytical  work  being  performed  on  an  algae  sample. 

The  rapid  settling  which  occurs  in  a  thawed  sample  makes  it  difficult  to  divide  the  sample  into 
aliquots  of  uniform  solids  concentration.  However,  freezing  and  thawing  is  an  excellent  method 
of  algae  cell  disruption.  Below  is  an  image  of  an  algae  sample  from  the  pilot  algae  treatment 
ponds  which  has  been  frozen  and  thawed.  The  picture  was  taken  approximately  30  seconds  after 
vigorous  shaking  of  the  sample.  A  layer  of  solids  is  visible  at  the  bottom  of  the  test  tube. 


Figure  1:  Thawed  and  Settled  Algae 


Analytical  Method 

In  order  to  characterize  the  quantity  and  quality  of  algal  oils,  a  program  was  developed  for  a  gas 
chromatograph/mass  spectrometer  (GC-MS).  The  GC-MS  is  an  instrument  which  allows  users 
to  analyze  the  molecular  composition  of  volatile  materials.  By  heating  a  sample,  which  has  been 
injected  into  a  long  capillary  column,  a  GC-MS  separates  constituents  of  the  sample  based  on 
their  volatilities.  As  compounds  emerge  from  the  end  of  the  capillary,  the  molecular  mass  of 
their  parts  is  determined  by  a  mass  spectrometer,  providing  for  their  identification. 

A  standard  solution  of  fatty  acid  methyl  esters  (FAMEs,  or  biodiesel  molecules)  was  prepared 
for  the  development  of  the  GC-MS  program  and  for  the  calibration  of  the  instrument.  Fully 
saturated  FAMEs  of  even-numbered  carbon  chain  lengths  between  8  and  24  were  used  because 
they  span  the  range  of  useful  carbon  chain  lengths  for  biodiesel  fuel.  The  GC-MS  program  was 
designed  to  provide  accurate  resolution  of  individual  molecules,  which  are  displayed  as  peaks  on 
the  graphical  output  of  the  GC-MS  instrument.  Next,  a  calibration  curve  was  constructed  to 
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calculate  recovery  rates  of  the  samples  processed  by  the  GC-MS.  The  development  of  the  GC- 
MS  program  and  calibration  curve  has  allowed  for  rapid  analysis  of  samples. 


Experimentation 

Once  methods  of  sample  collection  and  chromatographic  analysis  had  been  established,  an 
experiment  was  undertaken  to  determine  the  quantity  and  quality  of  lipids  produced  in  batch 
culture  algae  throughout  the  algal  growth  curve.  An  algae  pond  was  at  the  San  Luis  Obispo 
Water  fteclamation  Facility  was  reconfigured  to  run  in  batch  mode.  The  pond  was  sparged  with 
carbon  dioxide  in  order  to  improve  the  growth  rate  of  the  algae,  a  technique  described  in  a 
previous  thesis  project  at  Cal  Poly  (Feffer,  2007).  The  flow  of  carbon  dioxide  was  adjusted  each 
day  to  maintain  a  pH  of  approximately  7.75,  a  favorable  condition  for  algal  growth.  A  paddle 
wheel  rotating  at  approximately  6  rpm  was  used  to  provide  a  constant  flow  of  algae  water  around 
the  pond.  The  setup  is  pictured  below.  The  batch  mode  pond  was  inoculated  with  algae  which 
had  been  grown  in  an  adjacent  continuous  mode  pond  to  ensure  the  practicality  of  reproducing 
these  conditions  on  an  industrial  scale.  Inoculum  constituted  10%  of  the  total  volume  of  the 
pond.  The  other  90%  was  wastewater  from  the  primary  clarifier  at  the  water  reclamation  facility. 
The  total  volume  of  water  in  the  pond  was  250  gallons,  or  approximately  950  liters. 


Figure  2:  Batch  Mode  Algae  Pond 

During  each  day  of  operation  of  the  pond,  measurements  of  the  concentration  of  algae  in  the 
water  were  taken  in  order  to  document  the  growth  of  the  culture.  Microscopic  investigations  of 
the  micro  biota  of  the  pond  were  conducted  throughout  the  experiment  in  order  to  evaluate 
changes  in  the  species  and  number  of  algae  and  other  microorganisms  present  over  the  course  of 
the  operation  of  the  pond.  Lipid  extractions  were  performed  regularly  throughout  the  lifespan  of 
the  culture. 
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The  concentration  of  algae  in  the  pond  was  determined  by  performing  total  suspended  solids  and 
total  volatile  solids  experiments  each  day.  These  tests,  commonly  referred  to  collectively  as 
TSSA^SS,  involve  the  filtration  of  a  known  volume  of  sample  material  through  a  tared  filter.  By 
baking  the  filter  at  105C,  the  weight  of  the  solid  material  collected  on  it  is  obtained.  The  filter  is 
then  baked  at  525C  in  order  to  remove  combustible  material  from  the  filter.  The  weight  of  the 
combustible  material,  called  the  volatile  suspended  solids,  is  taken  to  be  the  dry  weight  of  the 
algae  initially  present  in  the  sample  volume.  Tests  were  performed  in  triplicate  and  the  average 
values  are  reported. 

Micrographic  analysis  of  the  algal  species  of  the  pond  was  performed  using  a  microscope 
equipped  with  a  digital  camera.  This  was  done  5  times  throughout  the  25  day  operation  of  the 
batch  mode  algae  pond. 

Regular  lipid  extractions  were  performed  using  the  Ennsani-amended  Bligh  and  Dyer  extraction 
procedure.  After  samples  were  retrieved  from  the  ponds,  they  were  rushed  immediately  to  a 
refrigerator,  in  which  they  were  kept  under  nitrogen  until  they  were  processed  a  maximum  5 
hours  later. 

The  first  processing  step  was  centrifugation.  Six  200mL  aliquots  per  day  were  centrifuged, 
resulting  in  a  small  pellet.  5mL  of  chloroform,  lOmL  of  methanol  and  4mL  of  deionized  water, 
and  were  then  added  to  resuspend  the  pellets.  A  sonicator  was  used  to  disrupt  the  algae  cells  in 
the  newly  suspended  mixture.  The  samples  were  then  placed  on  a  horizontal  shaker  table  with  6 
cm  oscillations  at  2  cycles  per  second  for  between  6  and  8  hours.  The  purpose  of  the  shaking 
step  was  to  promote  the  complete  exposure  of  intracellular  products  to  the  solvents. 

After  shaking,  an  additional  5mL  of  chloroform  and  5mL  of  deionized  water  was  added  to  each 
sample.  A  vortex  mixer  was  then  used  for  30  seconds  to  mix  the  newly  added  material.  The 
resulting  10:10:9  chloroform:methanol:water  mixture  was  centrifuged  for  4  minutes  in  order  to 
separate  the  hydrophilic  and  hydrophobic  layers.  A  test  tube  containing  the  mixture  at  this  stage 
is  pictured  below.  The  green  chloroform  layer,  at  the  bottom,  contains  lipids  and  chlorophyll. 
The  upper  layer  contains  methanol  and  water.  A  thin  layer  of  cell  debris  separates  the  two 
layers. 
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Figure  3;  Separated  Layers 

Onee  separated,  the  lower,  lipid  rieh  ehloroform  layer  was  removed  using  a  Pasteur  pipette  and 
added  to  a  tared  test  tube.  An  additional  lOmL  of  ehloroform  was  added  to  each  sample  before 
vortexing,  centrifuging  and  extracting  once  more.  The  purpose  of  performing  a  redundant 
extraction  was  to  encourage  the  complete  recovery  of  lipids  from  the  algal  material. 

Of  the  6  samples  taken  at  a  time,  three  were  used  to  analyze  the  quantity  of  lipids  in  the  algae. 
These  samples  were  extracted  into  tared  aluminum  trays  and  plaeed  in  a  nitrogen  sparged 
desiccator  in  order  to  evaporate  the  solvent  from  the  lipids.  Since  it  is  impractical  to  resuspend 
lipids  contained  in  an  aluminum  tray,  these  samples  were  no  longer  useful  for  chromatographic 
analysis .  The  advantage  of  using  trays  during  this  step  was  that  the  light  weight  of  aluminum 
trays  makes  them  ideal  for  obtaining  an  accurate  measurement  of  the  lipid  mass  they  contain. 
Nitrogen  was  used  in  order  to  prevent  oxidation  of  the  lipids,  which  may  interfere  with  their 
mass.  After  most  of  the  solvent  had  been  evaporated,  the  samples  were  plaeed  in  a  nitrogen 
sparged  oven  for  1  hour  at  105C  in  order  to  remove  any  remaining  solvent.  Evaporating  most  of 
the  solvent  at  ambient  temperature  prevented  the  rapid,  violent  vaporization  which  would  occur 
if  a  large  volume  of  solvent  had  been  plaeed  in  the  105C  oven.  This  was  done  to  preserve  the 
samples  in  their  entirety,  for  a  reliable  lipid  mass  result.  The  results  from  each  of  the  3  trays  were 
averaged  to  obtain  the  reported  numbers.  The  image  below  shows  trays  containing  algae  lipids 
in  the  nitrogen  sparged  desiccator.  The  lipids  are  green,  indicating  that  chlorophyll  is  extracted 
along  with  triglycerides. 


262 


NOOO 14-07-1-1 152 


P.I. Susan  C.  Opava,  Ph.D. 


Figure  4:  Lipid  Extracts  in  Desiccator 

The  remaining  three  samples  were  used  to  evaluate  the  types  of  lipids  present  in  each  sample. 
These  samples  were  extracted  into  glass  test  tubes  and  the  solvent  was  removed  by  evaporation 
in  a  nitrogen  sparged  desiccator.  The  use  of  sealable  test  tubes  in  this  step  made  it  possible  to 
subsequently  resuspend  the  samples  in  preparation  for  a  transesterification  reaction. 

The  transesterification  reaction  was  necessary  to  convert  the  algal  tryglicerides  into  FAMEs.  The 
light  molecular  weight  of  FAMEs  relative  to  the  triglycerides  from  which  they  are  derived  makes 
them  more  readily  analyzed  by  gas  chromatography.  The  first  step  of  the  transesterification  was 
to  resuspend  up  to  1  mg  of  the  oil  extracts  in  ImL  of  dry  toluene.  2mL  of  0.5M  anhydrous 
sodium  methoxide  in  methanol  were  then  added  to  the  samples.  Methanol  is  used  because 
methoxide  groups  in  the  mixture  bind  the  carbon  atom  central  to  each  carboxyl  group  within 
each  triglyceride,  breaking  the  triglycerides  apart  and  creating  three  FAMEs  from  each 
triglyceride.  This  reaction  was  catalyzed  by  placement  in  a  50C  water  bath  for  ten  minutes 
before  the  methoxide  was  neutralized  by  the  addition  of  0.  ImL  of  glacial  acetic  acid  to  each 
sample.  5mL  of  deionized  water  and  5mL  of  hexane  were  then  added,  and  the  FAME-rich 
hexane  layers  were  extracted.  An  additional  5mL  of  hexane  were  added  to  each  sample  to 
increase  the  completeness  of  FAME  recovery.  The  samples  were  then  dried  using  sodium 
sulfate  before  injection  into  GC-MS  instrument,  primarily  to  protect  the  GC-MS  equipment. 


Results 

Images  of  the  culture  throughout  the  experiment  are  shown  below.  The  first  image  shows  the 
inoculum,  grown  in  continuous  mode,  at  lOOOX  magnification.  The  spherical  algae  Anacystis 
was  present  in  the  inoculum  and  remained  the  dominant  species  throughout  the  experiment.  The 
next  image  is  a  1 OOOX  magnification  of  a  sample  taken  from  the  pond  on  day  9.  Anacystis  and 
scenedesmus  were  present  on  day  9.  Scenedesmus  appeared  shortly  after  the  experiment  was 
initiated  and  remained  for  the  duration  of  the  life  of  the  culture.  The  next  image  was  taken  at 
lOOOX  magnification  on  day  14  and  illustrates  the  increasing  diversity  of  the  culture  that  came 
with  time.  The  image  includes  Actinastrum  as  well  as  Scenedesmus  and  Anacystis.  The  last 
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image,  captured  on  day  2 1 ,  shows  the  cellular  debris  which  started  to  accumulate  in  the  pond  as 
the  algae  culture  declined. 


Figure  7:  Day  14 


Figure  8:  Day  21 


The  volatile  suspended  solids  of  the  inoculum  were  175mg/L  and  the  volatile  suspended  solids  of 
the  wastewater  which  was  used  in  the  pond  were  72mg/L.  The  inoculum  contained  17.1%  lipids 
by  weight  and  the  wastewater  contained  14.9%  lipids  by  weight.  The  total  volatile  solids 
remained  relatively  constant  over  the  course  of  the  first  5  days  of  the  experiment.  This  is  known 
as  a  “lag  phase”  and  it  results  from  the  adjustment  of  the  culture  to  a  new  environment.  The 
volatile  solids  then  increased  rapidly  in  what  is  known  as  an  “exponential  growth  phase,” 
peaking  at  527mg/L  on  day  17.  After  that,  the  volatile  solids  concentration  held  steady  at  about 
430mg/L  from  day  1 9  to  day  2 1 .  This  is  called  a  “stationary  phase”  and  it  preceded  at  period  of 
rapid  volatile  solids  decline  known  as  a  “death  phase.”  The  changes  in  the  volatile  solids 
concentration  were  similar  to  what  may  have  been  expected. 

The  growth  rate  of  algae  in  a  pond  system  is  typically  expressed  in  terms  of  the  change  in  the 
mass  of  volatile  suspended  solids  per  unit  pond  surface  area  per  day.  An  average  growth  rate  of 
6.3g/m^/day  was  recorded  over  the  growth  phase  of  the  culture  in  the  pond.  The  growth  rate 
peaked  at  10.8g/m^/day  on  day  17.  The  concentration  of  oil  in  the  algae  increased  with  the  algal 
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growth  rate  and  decreased  with  algal  culture  decline.  On  day  17,  at  the  time  of  maximum  algae 
growth,  lipids  constituted  19%  of  the  dry  mass  of  the  algae.  At  that  time  lipids  were  present  at  a 
concentration  of  approximately  lOOmg/L  in  the  bulk  growth  media  of  the  pond.  Assuming  a 
biodiesel  density  of  0.88g/cm^,  the  maximum  growth  rate  and  lipid  concentration  recorded  in  the 
pond  correspond  to  a  production  rate  of  approximately  91 1  gallons  of  biodiesel  per  acre  of  algae 
ponds  per  year. 

The  productivity  is  greater  than  values  typically  quoted  for  conventional  biodiesel  feedstocks 
such  as  palm  and  soy.  It  is  likely  that  even  higher  productivities  are  possible  with  wastewater 
algae  grown  under  improved  conditions.  This  experiment  was  conducted  between  March  and 
April  of  2009.  The  average  daily  high  temperature  of  approximately  65°F  was  lower  than  ideal. 
With  a  depth  of  approximately  8  inches,  the  algae  culture  was  significantly  shaded  by  the  2.5 
foot  tall  walls  of  the  algae  pond.  It  is  expected  that  a  culture  set  up  in  similar  conditions  would 
be  more  productive  if  shading  were  limited  and  the  temperature  was  higher.  The  growth  curve 
of  the  culture  is  pictured  below.  The  blue  line  represents  algae  concentration  in  the  bulk  growth 
media,  and  the  red  line  represents  lipid  concentration  in  the  bulk  growth  media.  Data  continues 
to  be  added  as  samples  from  the  experiment  are  processed. 


Lipid  Development  in  Batch  Culture  Algae 
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Figure  9:  Algae  and  Lipid  Development  in  Batch  Mode 


The  lipids  extracted  from  the  algae  are  currently  being  analyzed  using  the  GC-MS  instrument. 
Based  on  initial  results  from  the  batch  mode  experiment,  and  on  earlier  tests,  wastewater  algae 
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typically  produces  triglycerides  with  aliphatic  carbon  chains  of  between  14  and  18  carbon  atoms 
in  length.  The  most  common  FAME  is  a  completely  saturated,  16-earbon  chain.  Various  levels 
of  hydrogen  saturation  have  been  observed.  Some  of  the  chains  are  branched,  with  a  methyl 
group  cn  the  terminal,  or  third-to-last  carbon  on  the  chain.  Completely  saturated  arrangements 
are  the  most  common  and  of  the  unsaturated  arrangements  observed,  monounsaturated  molecules 
are  the  most  common.  These  results  are  encouraging  as  the  most  common  saturated  16  and  18- 
earbon  FAMEs  are  ideal  for  biodiesel  production.  Other  molecules  present  are  closely  related 
and  are  also  likely  to  be  suitable  for  biodiesel  production. 


GC-MS  chromatograms  from  day  1  of  the  batch  mode  pond  experiment,  and  results  from  an 
earlier  test  of  continuous  pond  algae  are  pictured  below.  Molecules  present  in  the  samples  show 
up  as  peaks  on  the  chromatograms.  The  horizontal  axes  in  the  chromatograms  represent  time, 
and  the  vertical  axes  represent  the  abundance  of  each  molecule.  FAMEs  which  are  appropriate 
for  use  as  fuel  have  been  identified  and  are  pictured  in  the  ball-and-stick  diagrams  superimposed 
on  each  of  the  chromatograms. 
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Figure  10:  Chromatogram  of  Batch  Mode  Algae  Lipids 


The  batch  mode  sample  consisted  primarily  of  saturated  16-carbon  and  monounsaturated  18- 
earbon  FAMEs.  Both  of  these  molecules  are  chemically  similar  to  constituents  of  palm  and 
vegetable  oils  which  are  commonly  used  to  produce  biodiesel.  The  tall  unnamed  peak  between 
the  FAMEs  is  dibutyl  phthalate,  a  common  plasticizer  used  in  the  production  of  inks,  adhesives 
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and  plastics.  Although  dibutyl  phthalate  is  periodically  present  in  chromatographic  samples,  it  is 
not  suspected  of  interfering  with  results. 
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Figure  11:  Chromatogram  of  Continuous  Mode  Algae  Lipids 


The  continuous  mode  sample  consisted  primarily  of  saturated  16  and  18-carbon  FAMEs  which 
are  also  common  to  biodiesel  produced  from  palm  or  vegetable  oil. 


Further  Research 

The  current  research  continues  to  provide  important  information  about  algae  lipid  production  and 
extraction.  Several  important  experiments  are  in  progress  currently.  Data  from  the  25  day  batch 
mode  experiment  continues  to  be  processed.  Pending  lab  results  will  provide  clear  information 
about  the  changes  in  concentrations  of  different  lipid  molecules  throughout  the  growth  of  the 
batch  algae  culture.  These  data  are  important  because  they  will  provide  insight  on  the  age  at 
which  algae  provide  the  best  lipids  for  biodiesel  fuel  production. 

A  large  experiment  comparing  the  extractive  properties  of  several  different  solvents  is  underway 
now.  The  solvents  include  methanol,  ethanol  and  isopropanol.  An  additional  extraction  will  be 
performed  using  high  temperature  methanol  to  determine  the  effect  of  solvent  temperature  on  the 
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quantit}'  and  quality  of  triglycerides  extracted.  The  results  of  each  of  these  solvent  extractions 
will  be  compared  to  Bligh  and  Dyer  data  from  the  same  algae  sample. 

Future  research  should  be  eonducted  on  the  effect  of  carbon  dioxide  addition  on  lipid  production 
and  lipid  quality.  Other  factors  which  may  have  an  influence  include  temperature  and  insolation 
rate.  Further  investigation  of  each  effect  will  provide  valuable  information  on  the  best  methods 
of  producing  algac-based  biodiesel  fuel. 

Although  the  current  research  will  provide  crucial  insight  into  the  triglycerides  which  can  be 
extracted  by  several  solvents,  additional  oil  processing  technologies  should  be  explored. 
Supercritical  carbon  dioxide  extraction,  although  relatively  expensive,  may  be  a  viable 
alternative  to  organic  solvent  extraction.  Physical  extraction  methods,  such  as  three-phase 
centrifugation  may  also  prove  to  be  good  methods  of  producing  biodiesel  from  algae  on  a  large 
scale. 
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Autonomous  Military  Robotics:  Risk,  Ethics,  and  Design 
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1.  Project  Proposal 


The  US  military  is  committed  to  using  battlefield  robots  as  part  of  Its  effort  to  develop  'Future 
Combat  Systems.'  Indeed,  Congress  has  already  mandated  that,  by  2010,  one-third  of  all  operational 
deep-strike  aircraft  must  be  unmanned,  and  by  2015,  one-third  of  all  ground  combat  vehicles  must 
be  unmanned— deadlines  that  are  also  driving  the  trend  toward  more  autonomous,  efficient  robots. 
Behind  these  commitments,  the  Armed  Services  have  several  specific  goals,  including:  (1)  to  save 
soldiers'  lives,  (2)  to  reduce  the  number  of  warfighters  needed  in  future  conflicts,  and  hence  (3)  to 


270 


NOOOl  4-07- 1-1 152 


P. I. Susan  C.  Opava,  Ph.D. 

I  2 

save  costs.  Further,  in  the  distant  future,  some  military  planners  hope  to  use  robots  to  engage  the 
enemy  dispassionately,  ensuring  compliance  with  the  Geneva  Conventions  and  other  standards  of 
ethical  conduct. 

However,  many  troubling  questions  arise  with  the  increasing  use  of  robotics  in  military  applications, 
particularly  given  the  fast-approaching  Congressional  deadlines  and  other  pressures.  These  troubling 
questions  include  the  fundamental  challenge  of  designing  machines  that  can  'think  ethically'  in  the 
first  place  as  well  as  more  distant  concerns  of  robots  gone  wild. 

The  need  for  technology  risk  assessment  in  this  area— and,  more  broadly,  for  'robot  ethics'  or 
'roboethics'— is  clear  given  recent  failures  of  even  semi-autonomous  military  and  civilian  systems, 
e.g.,  malfunction  of  a  South  African  robotic  cannon  that  inadvertently  killed  nine  soldiers  and 
wounded  14  others.  Further,  Europe  is  leading  efforts  in  robot  ethics,  given  years  of  workshops, 
conferences,  and  reports  they've  produced  on  the  subject  already.  But  the  US  is  starting  to  catch  up. 

In  its  first  year,  our  interdisciplinary  research  project  proposes  to:  identify  the  benefits  and  risks  from 
robotics  to  the  US  military,  including  a  survey  of  current  and  emerging  robots;  provide  a  framework 
for  investigating  robot  ethics;  look  primarily  at  near-  and  mid-term  issues  and  risk;  and  then  provide 
a  quick  preview  of  far-term  issues.  This  project  would  rely  on  an  extensive  literature  review, 
interviews  with  industry  experts,  and  both  online  and  offline  research. 

Our  goal  is  to  leverage  this  work  into  a  much  larger  project  funded  by  other  federal  grants  and 
industry  support.  We  plan  to  submit  proposals  to  NSF,  ONR,  DARPA,  and  other  organizations,  and 
we  collaborate  with  industry  companies  and  other  organizations  (such  as  Yale  University  and  the  U.S. 
Naval  Academy)  during  the  course  of  the  entire  project. 


2.  Relevance  to  ONR/DoD 


This  interdisciplinary  project  not  only  seeks  to  responsibly  guide  developments  in  robotics— as  a 
significant  enabler  of  taking  the  US  military  into  the  next  generation— but  it  also  attends  to  many 
areas  of  interest  to  the  ONR/DoD,  including:  (1)  national  security  applications  (e,g.,  remote  sensing, 
robotics,  biosensing/detection,  expert  systems),  [2]  farce  protection  (e.g.,  improved  protection  of  the 
individual),  (3)  human  performance,  training,  and  survivability  (e.g.,  cognitive  and  physical 
performance  enhancement),  and  (4)  intelligence,  surveillance,  and  reconnaissance  (e.g., 
data/information  analysis  and  distribution).  Our  proposal  also  satisfies  other  priorities  in  the 
program,  such  as  helping  to  seed  new  research  programs  of  junior  faculty,  attract  future  funding, 
build  industry  ties,  and  so  forth. 
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3.  Project  Team  &  Collaborators 


Robot  ethicS;  and  even  more  so  with  respect  to  military  systems,  is  an  emerging  and  interdisciplinary 
field  that  continues  to  draw  from  experts  in  robotics,  technology  ethics,  and  other  prior  fields.  Our 
research  team  at  Cal  Poly,  therefore.  Is  interdisciplinary  and  uniquely  qualified  to  execute  this 
project:  Dr.  Patrick  Lin,  director  of  the  Ethics  &  Emerging  Technologies  Group  and  on  the  philosophy 
department  faculty;  Dr,  George  Bekey,  research  fellow  in  the  biomedical  engineering  department 
and  founder  of  University  of  Southern  California's  robotics  lab,  where  he  is  also  a  professor  emeritus; 
and  Keith  Abney,  also  on  the  philosophy  department  faculty  and  engaged  in  technology  and 
biomedical  ethics. 

We  have  also  enlisted  the  assistance  of  the  following  consultants,  all  experts  in  the  field  of 
machine/robot  ethics:  Colin  Allen  (Indiana  Univ.),  Peter  Asaro  (Rutgers  Univ.),  and  Wendell  Wallach 
(Yale).  We  have  also  conducted  in-person  and  online  discussions  with  the  following  experts:  Ron 
Arkin  (Georgia  Tech),  John  Canning  (Naval  Surface  Warfare  Center),  Ken  Goldberg  (IEEE  Robotics  and 
Automation  Society;  UC  Berkeley),  Patrick  Hew  (Defence  Science  and  Technology  Organization, 
Australia),  George  R.  Lucas,  Jr.  (US  Naval  Academy),  Frank  Chongwoo  Park  (IEEE  Robotics  and 
Automation  Society;  Seoul  National  Univ.),  Lt.  Col.  Gary  Sargent  (US  Army  Special  Forces;  Cal  Poly), 
Noel  Sharkey  (Univ.  of  Sheffield,  UK),  Rob  Sparrow  (Monash  Univ.,  Australia),  and  others. 


4.  Research  Results 


We  have  completed  a  100+  page  preliminary  report  that  achieves  the  research  goals  set  forth  above. 
The  full  report  is  attached,  and  a  summary  of  the  report  and  some  conclusions  are  as  follows: 

In  section  1,  we  begin  by  building  the  case  for  'robot  ethics.'  While  there  are  substantial  benefits  to 
be  gained  from  the  use  of  military  robots,  there  are  also  many  opportunities  for  these  machines  to 
act  inappropriately,  especially  as  they  are  given  greater  degrees  of  autonomy  (for  quicker,  more 
efficient,  and  more  accurate  decision-making,  and  if  they  are  to  truly  replace  human  soldiers).  The 
need  for  robot  ethics  becomes  more  urgent  when  we  consider  pressures  driving  the  market  for 
military  robotics  as  well  as  long-standing  public  skepticism  that  lives  In  popular  culture. 

In  section  2,  we  lay  the  foundation  for  a  robot-ethics  investigation  by  presenting  a  wide  range  of 
military  robots— ground,  aerial,  and  marine— currently  in  use  and  predicted  for  the  future.  While 
most  of  these  robots  today  are  semi-autonomous  (e.g.,  the  US  Air  Force's  Predator),  some 
apparently-fully  autonomous  systems  are  emerging  (e.g.,  the  US  Navy's  Phalanx  CIWS)  though  used 
In  a  very  limited,  last-resort  context.  From  this,  we  can  already  see  ethical  questions  emerge, 
especially  related  to  the  ability  to  discriminate  combatants  from  non-combatants  and  the 
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circumstances  under  which  robots  can  make  attack  decisions  on  their  own.  We  return  to  these 
questions  in  subsequent  sections,  particularly  section  7. 

In  section  3,  we  look  at  behavioral  frameworks  that  might  ensure  ethical  actions  in  robots.  It  Is 
natural  to  consider  various  programming  approaches,  since  robots  are  related  to  our  personal  and 
business  computer  systems  today  that  also  depend  on  programmed  instructions.  We  also  recognize 
the  forward-looking  nature  of  our  discussions  here,  given  that  the  more-sophisticated  programming 
abilities  needed  to  build  truly  autonomous  robotics  are  still  under  development. 

We  first  discuss  the  traditional  approach  of  top-down  programming,  i.e.,  establishing  general  rules 
that  the  robot  would  follow.  A  clear  example  is  a  deontological  approach,  such  as  using  Kant's 
Categorical  Imperative  or  Asimov's  Laws  of  Robotics.  However,  a  rigid  set  of  rules  is  likely  not  robust 
enough  to  arrive  at  the  correct  action  or  decision  In  enough  cases,  particularly  in  unforeseen  and 
complex  scenarios.  This  suggests  that  we  also  need  to  attend  to  the  'rightness'  of  the  result  itself, 
not  just  to  the  rules.  But  even  If  we  acknowledge  that  consequences  matter,  there  are  other 
challenges  raised  by  adopting  a  consequentlallst/utilltarlan  approach,  such  as  the  impracticality  of 
calculating  and  weighing  all  possible  results,  both  near  and  far  term,  and  the  (strong)  possibility  of 
countenancing  some  intuitively-wrong  action. 

Given  the  apparent  limitations  of  top-down  programming,  we  then  examine  bottom-up  approaches, 
inspired  by  biological  evolution  and  human  development.  However,  a  key  challenge  is  that  bottom- 
up  systems  work  best  when  they  are  directed  at  achieving  one  clear  goal,  but  military  robots  often 
operate  in  dynamic  environments  in  which  available  information  is  confusing  or  incomplete.  That  is, 
even  If  moral  calculation  Is  not  an  Issue,  there  still  remains  the  large  problem  of  moral  psychology, 
I.e.,  how  to  develop  robots  that  embody  the  right  tendencies  in  their  reactions  to  the  world  and 
other  agents  in  that  world,  particularly  when  the  robots  are  confronted  with  a  novel  situation  in 
which  they  cannot  rely  on  experience. 

Moral  reasoning  by  humans,  however.  Is  not  limited  to  exclusively  a  top-down  or  bottom-up 
approach;  rather,  we  often  use  both  strategies  of  rule-following  and  experience.  (Nonetheless,  it  is 
useful  to  evaluate  both  programming  approaches  separately  to  Identify  their  benefits  and 
challenges.)  Therefore,  we  consider  a  hybrid  approach  of  virtue  ethics  for  constructing  ethical 
autonomous  robots.  This  approach  is  concerned  with  the  development  of  moral  character;  in  the 
military  case,  with  promoting  the  ideal  character  traits  of  a  warfighter,  i.e.,  a  'warrior  code  of  ethics' 
as  its  virtues. 

In  section  4,  we  look  at  considerations  in  programming  the  Laws  of  War  (LOW)  and  Rules  of 
Engagement  (ROE),  which  may  differ  from  mission  to  mission,  into  a  robot.  No  matter  which 
programming  approach  is  adopted,  we  at  least  would  want  to  the  robot  to  obey  the  LOW  and  ROE, 
and  this  might  serve  as  a  proxy  for  full-fledged  morality  until  we  have  the  capability  to  program  a 
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robot  with  the  latter.  Such  an  approach  has  several  advantages,  including:  (1)  any  problems  from 
moral  relativism/particularism  or  other  problems  with  general  ethical  principles  are  avoided;  and  (2) 
the  relationship  of  morality  to  legality— a  minefield  for  ethics— is  likewise  largely  avoided,  since  the 
LOW  and  ROE  make  clear  what  actions  are  legal  and  illegal  for  robots,  which  serves  as  a  reasonable 
approximation  to  the  moral-immoral  distinction. 

Our  discussion  of  the  LOW  and  ROE,  then,  delves  into  their  underlying  foundation  in  just-war  theory, 
particularly  jus  od  bellum  (moral  justification  for  entering  war)  and  jus  in  bello  (just  and  unjust 
actions  in  the  prosecution  of  a  war).  We  also  examine  ethical  challenges  to  just-war  theory  as 
related  to  military  robotics:  Some  have  objected  to  the  use  of  military  robotics  on  the  grounds  that  it 
makes  easier  the  decision  to  enter  war,  in  apparent  violation  of  jus  ad  bellum;  and  we  again  see  that 
the  technical  ability  to  properly  discriminate  against  targets,  as  required  by  jus  in  bello,  is  a  concern. 

In  section  5,  we  attend  to  the  recurring  possibility  of  accidental  or  unauthorized  harm  caused  by 
robots;  who  would  be  responsible  ultimately  for  those  mishaps?  We  look  at  the  Issue  through  the 
lens  of  legal  liability,  both  when  robots  are  considered  as  merely  products  and  when,  as  they  are 
given  more  autonomy,  they  might  be  treated  as  legal  agents,  e.g.,  as  legal  quasi-persons  such  as 
children  are  regarded  by  the  law.  In  the  latter  case,  it  is  not  clear  how  we  would  punish  robots  for 
their  inappropriate  actions. 

In  section  6,  still  attending  to  the  possibility  of  unintended  or  unforeseen  harm  committed  by  a 
robot,  we  broaden  our  discussion  by  looking  at  how  we  might  think  about  general  risks  posed  by  the 
machines  and  their  acceptability.  We  offer  a  preliminary  framework  for  a  technology  risk 
assessment,  which  includes  the  key  factors  of  consent,  informed  consent,  affected  population, 
seriousness,  and  probability.  This  assessment  highlights  further  the  need  for  a  lengthy  period  of 
rigorous  testing  and  gradual  rollout  (crawl-walk-run  approach)  as  a  moral  minimum  for  the 
responsible  deployment  of  autonomous  robots,  especially  by  the  military. 

Final  y,  in  section  7,  we  bring  together  a  full  range  of  issues  raised  throughout  our  examination,  as 
well  as  some  new  issues,  that  must  be  recognized  in  any  comprehensive  assessment  of  risks  from 
military  robotics.  These  challenges  fall  into  categories  related  to  law,  just-war  theory,  technical 
capabilities,  human-robot  interactions,  general  society,  and  other  and  future  issues.  For  instance, 
we  discuss  such  issues  as: 

•  If  a  military  robot  refuses  an  order,  e.g.,  if  it  has  better  situational  awareness,  then  who 
would  be  responsible  for  its  subsequent  actions? 

•  How  stringently  should  we  take  the  generally-accepted  'eyes  on  target'  requirement,  i.e., 
under  what  circumstances  might  we  allow  robots  to  make  attack  decisions  on  their  own? 

•  What  precautions  ought  to  be  taken  to  prevent  robots  from  running  amok  or  turning  against 
our  own  side,  whether  through  malfunction,  programming  error,  or  capture  and  hacking? 
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•  To  the  extent  that  military  robots  can  help  reduce  instances  of  war  crimes,  what  is  the  harm 
that  may  arise  if  the  robots  also  unintentionally  erode  squad  cohesion  given  their  role  as  an 
'outside'  observer? 

•  Should  robots  be  programmed  to  defend  themselves— contrary  to  Arkin's  position— given 
that  they  represent  costly  assets? 

•  Would  using  robots  be  counterproductive  to  winning  the  hearts  and  minds  of  occupied 
populations  or  result  in  more  desperate  terrorist-tactics  given  an  increasing  asymmetry  in 
warfare? 

From  the  preceding  investigation,  we  can  draw  some  general  and  preliminary  conclusions,  including 
some  future  work  needed: 

1.  Creating  autonomous  military  robots  that  can  act  at  least  as  ethically  as  human  soldiers 
appears  to  be  a  sensible  goal,  at  least  for  the  foreseeable  future  and  in  contrast  to  a  greater 
demand  of  a  perfectly-ethical  robot.  However,  there  are  still  daunting  challenges  in  meeting 
even  this  relatively-low  standard,  such  as  the  key  difficulty  of  programming  a  robot  to 
reliably  distinguish  enemy  combatants  from  non-combatants,  as  required  by  the  Laws  of 
War  and  most  Rules  of  Engagement. 

2.  While  a  faster  Introduction  of  robots  in  military  affairs  may  save  more  lives  of  human 
soldiers  and  reduce  war  crimes  committed,  we  must  be  careful  to  not  unduly  rush  the 
process.  Much  different  than  rushing  technology  products  to  commercial  markets,  design 
and  programming  bugs  in  military  robotics  would  likely  have  serious,  fatal  consequences. 
Therefore,  a  rigorous  testing  phase  of  robots  is  critical,  as  well  as  a  thorough  study  of  related 
policy  issues,  e.g.,  how  the  US  Federal  Aviation  Administration  (FAA)  handles  UAVs  flying  in 
our  domestic  National  Airspace  System  (which  we  have  not  addressed  here). 

3.  Understandably,  much  ongoing  work  In  military  robotics  is  likely  shrouded  in  secrecy;  but  a 
balance  between  national  security  and  public  disclosure  needs  to  be  maintained  in  order  to 
help  accurately  anticipate  and  address  issues  of  risk  or  other  societal  concerns.  For  instance, 
there  Is  little  information  on  US  military  plans  to  deploy  robots  in  space,  yet  this  seems  to  be 
a  highly  strategic  area  in  which  robots  can  lend  tremendous  value;  however,  there  are 
important  environmental  and  political  sensitivities  that  would  surround  such  a  program. 

4.  Serious  conceptual  challenges  exist  with  the  two  primary  programming  approaches  today: 
top-down  (e.g.,  rule-following)  and  bottom-up  (e.g.,  machine  learning).  Thus  a  hybrid 
approach  should  be  considered  in  creating  a  behavioral  framework.  To  this  end,  we  need  to 
a  clear  understanding  of  what  a  'warrior  code  of  ethics'  might  entail,  if  we  take  a  virtue- 
ethics  approach  in  programming. 
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5.  In  the  meantime;  as  we  wait  for  technology  to  sufficiently  advance  in  order  to  create  a 
workable  behavioral  framework;  it  may  be  an  acceptable  proxy  to  program  robots  to  comply 
with  the  Law  s  of  War  and  appropriate  Rules  of  Engagement.  However;  this  too  is  much 
easier  said  than  done;  and  at  least  the  technical  challenge  of  proper  discrimination  would 
persist  and  require  resolution. 

6.  Given  technical  limitations;  such  as  programming  a  robot  with  the  ability  to  sufficiently 
discriminate  against  valid  and  invalid  targets;  we  expect  that  accidents  will  continue  to 
occur,  which  raise  the  question  of  legal  responsibility.  More  work  needs  to  be  done  to 
clarify  the  chain  of  responsibility  in  both  military  and  civilian  contexts.  Product  liability  laws 
are  informative  but  untested  as  they  relate  to  robotics  with  any  significant  degree  of 
autonomy. 

7.  Assessing  technological  risks,  whether  through  the  basic  framework  we  offer  in  section  6  or 
some  other  framework,  depend  on  identifying  potential  issues  in  risk  and  ethics.  These 
issues  vary  from:  foundational  questions  of  whether  autonomous  robotics  can  be  legally  and 
morally  deployed  in  the  first  place,  to  theoretical  questions  about  adopting  precautionary 
approaches,  to  forward-looking  questions  about  giving  rights  to  truly  autonomous  robots. 
These  discussions  need  to  be  more  fully  developed  and  expanded. 

3.  Specifically,  the  challenge  of  creating  a  robot  that  can  properly  discriminate  among  targets  is 
one  of  the  most  urgent,  particularly  if  one  believes  that  the  (increased)  deployment  of  war 
robots  is  inevitable.  While  this  is  a  major  technical  challenge— the  solution  to  which 
depends  on  advances  in  programming  and  Al— there  are  also  some  workaround  policy 
solutions  that  can  be  anticipated  and  further  explored,  such  as:  limiting  deployment  of  lethal 
robots  to  only  inside  a  'kill  box';  or  designing  a  robot  to  target  only  other  machines  or 
weapons;  or  not  giving  robots  a  self-defense  mechanism  so  that  they  may  act  more 
conservatively  to  prevent;  or  even  creating  robots  with  only  non-lethal  or  less-than-lethal 
strike  capabilities,  at  least  initially  until  they  are  proven  to  be  reliable. 

These  and  other  considerations  warrant  further,  more  detailed  investigations  in  military  robotics  and 
Issues  of  design,  risk,  and  ethics.  Such  interdisciplinary  investigations  will  require  collaboration 
among  policymakers  and  analysts,  roboticists,  ethicists,  sociologists,  psychologists,  and  others. 
Internationally  and  including  the  general  public  as  a  key  stakeholder.  And  this  work  has  the  potential 
to  be  as  broad  as  other  fields  In  science  and  society,  such  as  bioethics  or  computer  ethics. 

The  use  of  military  robots  represents  a  new  era  in  warfare,  perhaps  more  so  than  crossbows, 
airplanes,  nuclear  weapons,  and  other  innovations  have  previously.  Robots  are  not  merely  another 
asset  in  the  military  toolbox,  but  they  are  meant  to  also  replace  human  soldiers,  especially  in  'dull, 
dirty,  and  dangerous'  jobs.  As  such,  they  raise  novel  ethical  and  social  questions  that  we  should 
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confront  as  far  in  advance  as  possible— particularly  before  irrational  public  fears  or  accidents  arising 
from  military  robotics  derail  research  progress  and  national  security  interests. 


5.  Next  Steps 


With  second-year  funding  from  ONR,  the  following  objectives  are  designed  to  leverage  our  first-year 
ONR  project  work— extending  that  investment  and  further  disseminating  our  research.  These 
additional  activities  will  serve  also  to  strengthen  Cal  Poly's  profile  in  technology  ethics,  particularly 
with  respect  to  robotics,  to  attract  more  projects  across  the  university  as  well  as  Interest  from 
academic  and  industry  partners. 

(i)  To  develop  one  of  the  first  anthologies  in  robot  ethics,  with  a  strong  focus  on  military 
systems; 

(ii)  To  develop  and  submit  a  robot-ethics  paper  at  a  relevant  conference  to  more  immediately 
engage  the  robotics  community  and  broader  public; 

(iii)  To  develop  one  of  the  first  university-level  courses  on  robot  ethics,  with  a  strong  focus  on 
military  systems; 

(iv)  To  develop  a  website  for  robot  ethics,  as  a  way  to  disseminate  research  and  engage  the 
community  and  larger  public; 

(v)  To  expand  our  network  of  contacts— and  Cal  Poly's  by  extension— In  the  field  through  the 
above  activities,  including  retaining  new  outside  consultants  for  our  second-year;  and 

(vi)  To  leverage  this  work  into  a  much  larger  project  supported  by  other  federal  and  industry 
sources,  such  as  NSF  and  DARPA. 


6.  Contact 


Patrick  Lin,  Ph.D. 

California  Polytechnic  State  University 

Ethics  &  Emerging  Technologies  Group 

Philosophy  Department 

1  Grand  Avenue 

Building  47,  Room  37 

San  Luis  Obispo,  California  93407 

Email:  palin@calpoly.edu 

Dept,  phone:  805-756-2041 
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Preface 


This  report  is  designed  as  a  preliminary  investigation  into  the  risk  and  ethics  issues  related  to 
autonomous  military  systems,  with  a  particular  focus  on  battlefield  robotics  as  perhaps  the  most 
controversial  area.  It  is  intended  to  help  inform  policymakers,  military  personnel,  scientists,  as  well 
as  the  broader  public  who  collectively  influence  such  developments.  Our  goal  is  to  raise  the  issues 
that  need  to  be  consider  in  responsibly  introducing  advanced  technologies  into  the  battlefield  and, 
eventually.  Into  society.  With  history  as  a  guide,  we  know  that  foresight  is  critical  to  both  mitigate 
undesirable  effects  as  well  as  to  best  promote  or  leverage  the  benefits  of  technology. 

In  this  report,  we  will  present:  the  presumptive  case  for  the  use  of  autonomous  military  robotics;  the 
need  to  address  risk  and  ethics  in  the  field;  the  current  and  predicted  state  of  military  robotics; 
programming  approaches  as  well  as  relevant  ethical  theories  and  considerations  (including  the  Laws 
of  War,  Rules  of  Engagement);  a  framework  for  technology  risk  assessment;  ethical  and  social  issues, 
both  near-  and  far-term;  and  recommendations  for  future  work. 

This  work  is  sponsored  by  the  US  Department  of  the  Navy,  Office  of  Naval  Research,  under  Award  # 
N00014-07-1-1152,  whom  we  thank  for  its  support  and  interest  in  this  important  investigation.  We 
also  thank  California  State  Polytechnic  University  (Cal  Poly,  San  Luis  Obispo)  for  its  support, 
particularly  the  College  of  Liberal  Arts  and  the  College  of  Engineering. 

We  are  indebted  to  Colin  Allen  (Indiana  Univ.),  Peter  Asaro  (Rutgers  Univ.),  and  Wendell  Wallach 
(Yale)  for  their  counsel  and  contributions,  as  well  as  to  a  number  of  colleagues— Ron  Arkin  (Georgia 
Tech),  John  Canning  (Naval  Surface  Warfare  Center),  Ken  Goldberg  (IEEE  Robotics  and  Automation 
Society;  UC  Berkeley),  Patrick  Hew  (Defence  Science  and  Technology  Organization,  Australia),  George 
R.  Lucas,  Jr.  (US  Naval  Academy),  Frank  Chongwoo  Park  (IEEE  Robotics  and  Automation  Society;  Seoul 
National  Univ.),  Lt.  Col.  Gary  Sargent  (US  Army  Special  Forces;  Cal  Poly),  Noel  Sharkey  (Univ.  of 
Sheffield,  UK),  Rob  Sparrow  (Monash  Univ.,  Australia),  and  others— for  their  helpful  discussions.  We 
also  thank  the  organizations  mentioned  herein  for  use  of  their  respective  images.  Finally,  we  thank 
our  families  and  nation's  military  for  their  service  and  sacrifice. 
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1.  Introduction 


"No  catalogue  of  horrors  ever  kept  men  from  war.  Before  the  war  you  always  think 
that  it's  not  you  that  dies.  But  you  will  die,  brother,  if  you  go  to  it  long  enough."— 
Ernest  Hemingway  [1935,  p.l56] 


Imagine  the  face  of  warfare  with  autonomous  robotics:  Instead  of  our  soldiers  returning  home  in 
flag-draped  caskets  to  heartbroken  families,  autonomous  robots— mobile  machines  that  can  make 
decisions,  such  as  to  fire  upon  a  target,  without  human  intervention— can  replace  the  human  soldier 
in  an  increasing  range  of  dangerous  missions:  from  tunneling  through  dark  caves  in  search  of 
terrorists,  to  securing  urban  streets  rife  with  sniper  fire,  to  patrolling  the  skies  and  waterways  where 
there  is  little  cover  from  attacks,  to  clearing  roads  and  seas  of  improvised  explosive  devices  (lEDs),  to 
surve?ying  damage  from  biochemical  weapons,  to  guarding  borders  and  buildings,  to  controlling 
potentially-hostile  crowds,  and  even  as  the  infantry  frontlines. 

These  robots  would  be  'smart'  enough  to  make  decisions  that  only  humans  now  can;  and  as  conflicts 
increase  in  tempo  and  require  much  quicker  information  processing  and  responses,  robots  have  a 
distinct  advantage  over  the  limited  and  fallible  cognitive  capabilities  that  we  Homo  sapiens  have. 
Not  only  would  robots  expand  the  battlespace  over  difficult,  larger  areas  of  terrain,  but  they  also 
represent  a  significant  force-multiplier— each  effectively  doing  the  work  of  many  human  soldiers, 
while  immune  to  sleep  deprivation,  fatigue,  low  morale,  perceptual  and  communication  challenges 
in  the  'fog  of  war',  and  other  performance-hindering  conditions. 

But  the  presumptive  case  for  deploying  robots  on  the  battlefield  is  more  than  about  saving  human 
lives  or  superior  efficiency  and  effectiveness,  though  saving  lives  and  clearheaded  action  during 
frenetic  conflicts  are  significant  issues.  Robots,  further,  would  be  unaffected  by  the  emotions, 
adrenaline,  and  stress  that  cause  soldiers  to  overreact  or  deliberately  overstep  the  Rules  of 
Engagement  and  commit  atrocities,  that  is  to  say,  war  crimes.  We  would  no  longer  read  (as  many) 
news  reports  about  our  own  soldiers  brutalizing  enemy  combatants  or  foreign  civilians  to  avenge  the 
deaths  of  their  brothers  in  arms— unlawful  actions  that  carry  a  significant  political  cost.  Indeed, 
robots  may  act  as  objective,  unblinking  observers  on  the  battlefield,  reporting  any  unethical  behavior 
back  to  command;  their  mere  presence  as  such  would  discourage  all-too-human  atrocities  in  the  first 
place. 
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Technology,  however,  is  a  double-edge  sword  with  both  benefits  and  risks,  critics  and  advocates;  and 
autonomous  military  robotics  is  no  exception,  no  matter  how  compelling  the  case  may  be  to  pursue 
such  research.  The  worries  include:  where  responsibility  would  fall  in  cases  of  unintended  or 
unlawful  harm,  which  could  range  from  the  manufacturer  to  the  field  commander  to  even  the 
machine  itself;  the  possibility  of  serious  malfunction  and  robots  gone  wild;  capturing  and  hacking  of 
military  robots  that  are  then  unleashed  against  us;  lowering  the  threshold  for  entering  conflicts  and 
wars,  since  fewer  US  military  lives  would  then  be  at  stake;  the  effect  of  such  robots  on  squad 
cohesion,  e.g.,  if  robots  recorded  and  reported  back  the  soldier's  every  action;  refusing  an  otherwise- 
legitimate  order;  and  other  possible  harms. 

We  will  evaluate  these  and  other  concerns  within  our  report;  and  the  remainder  of  this  section  will 
discuss  the  driving  forces  in  autonomous  military  robotics  and  the  need  for  'robot  ethics',  as  well  as 
provide  an  overview  of  the  report.  Before  that  discussion,  we  should  make  a  few  introductory  notes 
and  definitions  as  follow. 


1.1  Opening  Remarks 


First,  in  this  investigation,  we  are  not  concerned  with  the  question  of  whether  it  is  even  technically 
possible  to  make  a  perfectly-ethical  robot,  i.e.,  one  that  makes  the  'right'  decision  in  every  case  or 
even  most  cases.  Following  Arkin,  we  agree  that  an  ethically-infallible  machine  ought  not  to  be  the 
goal  now  (if  it  is  even  possible);  rather,  our  goal  should  be  more  practical  and  immediate:  to  design  a 
machine  that  performs  better  than  humans  do  on  the  battlefield,  particularly  with  respect  to 
reducing  unlawful  behavior  or  war  crimes  (Arkin,  2007].  Considering  the  number  of  incidences  of 
unlawful  behavior— and  by  'unlawful'  we  mean  a  violation  of  the  various  Laws  of  War  (LOW)  or  Rules 
of  Engagement  (ROE),  which  we  also  will  discuss  later  in  more  detail— this  appears  to  be  a  low 
standard  to  satisfy,  though  a  profoundly  important  hurdle  to  clear.  To  that  end,  scientists  and 
engineers  need  not  first  solve  the  daunting  task  of  creating  a  truly  'ethical'  robot,  at  least  in  the 
foreseeable  future;  rather,  it  seems  that  they  only  need  to  program  a  robot  to  act  in  compliance  with 
the  LOW  and  ROE  (though  this  may  not  be  as  straightforward  and  simply  as  it  first  appears)  or  act 
ethically  In  the  specific  situations  in  which  the  robot  is  to  be  deployed. 

Second,  we  should  note  that  the  purpose  of  this  report  is  not  to  encumber  research  on  autonomous 
military  robotics,  but  rather  to  help  responsibly  guide  it.  That  there  should  be  two  faces  to 
technology— benefits  and  risk— is  not  surprising,  as  history  shows,  and  is  not  by  Itself  an  argument 
against  that  technology.^  But  ignoring  those  risks,  or  at  least  only  reactively  addressing  them  and 

^  Biotechnology,  for  instance,  promises  to  reduce  world  hunger  by  promoting  greater  and  more  nutritious  agricultural 
and  livestock  yield;  yet  continuing  concerns  about  the  possible  dissemination  of  bio-engineered  seeds  (or 
Trankenfoods')  into  the  wild,  displacing  native  plants  and  crops,  have  prompted  the  industry  to  move  more 
cautiously  [e.g.,  Thompson,  2007].  Even  Internet  technologies,  as  valuable  as  they  have  been  in  connecting  us  to 
information,  social  networks,  etc.,  and  In  making  new  ways  of  life  possible,  reveal  a  darker  world  of  online  scams, 
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waiting  for  public  reaction,  seems  to  be  unwise,  given  that  it  can  lead  (and,  in  the  case  of  biotech 
foods,  has  led)  to  a  backlash  that  stalls  forward  progress. 

Thai;  said.  It  is  surprising  to  note  that  one  of  the  most  comprehensive  and  recent  reports  on  military 
robotics.  Unmanned  Systems  Roadmap  2007-2032,  does  not  mention  the  word  'ethics'  once  nor  risks 
raised  by  robotics,  with  the  exception  of  one  sentence  that  merely  acknowledges  that  "privacy  issues 
[have  been]  raised  In  some  quarters"  without  even  discussing  said  Issues  [US  Department  of 
Defense,  2007,  p.  48].  While  this  omission  may  be  understandable  from  a  public  relations 
standpoint,  again  it  seems  short-sighted  given  lessons  in  technology  ethics,  especially  from  our 
recent  past.  Our  report,  then,  is  designed  to  address  that  gap,  proactively  and  objectively  engaging 
policymakers  and  the  public  to  head  off  a  potential  backlash  that  serves  no  one's  interests. 

Third,  while  this  report  focuses  on  issues  related  to  autonomous  military  robotics,  the  discussion  may 
apply  equally  well  and  overlap  with  issues  related  to  autonomous  military  systems,  i.e.,  computer 
networks.  Further,  we  are  focusing  on  battlefield  or  lethal  applications,  as  opposed  to  robotics  in 
manufacturing  or  medicine  even  if  they  are  supported  by  military  programs  (such  as  the  Battlefield 
Extraction  Assist  Robot,  or  BEAR,  that  carries  injured  soldiers  from  combat  zones),  for  several 
reasons  as  follow.  The  most  contentious  military  robots  will  be  the  weaponized  ones:  "Weaponized 
unmanned  systems  Is  a  highly  controversial  issue  that  will  require  a  patient  'crawl-walk-run' 
approach  as  each  application's  reliability  and  performance  is  proved"  [US  Department  of  Defense, 
2007,  p.  54].  Their  deployment  is  inherently  about  human  life  and  death,  both  intended  and 
unintended,  so  they  immediately  raise  serious  concerns  related  to  ethics  (e.g.,  does  just-war  theory 
or  the  LOW/ROE  allow  for  deployment  of  autonomous  fighting  systems  in  the  first  place?)  as  well  as 
risk  (e.g.,  malfunctions  and  emergent,  unexpected  behavior)  that  demand  greater  attention  than 
other  robotics  applications. 

Also,  though  a  relatively  small  number  of  military  personnel  is  ever  exposed  on  the  battlefield,  loss  of 
life  and  property  during  armed  conflict  has  non-trivial  political  costs,  never  mind  environmental  and 
economic  costs,  especially  if  'collateral'  or  unintended  damage  is  inflicted  and  even  more  so  if  it 
results  from  abusive,  unlawful  behavior  by  our  own  soldiers.  How  we  prosecute  a  war  or  conflict 
receives  particular  scrutiny  from  the  media  and  public,  whose  opinions  influence  military  and  foreign 
policy  even  if  those  opinions  are  disproportionately  drawn  from  events  on  the  battlefield,  rather 
than  on  the  many  more  developments  outside  the  military  theater.  Therefore,  though  autonomous 
batt  efield  or  weaponized  robots  may  be  years  away  and  account  for  only  one  segment  of  the  entire 
military  robotics  population,  there  is  much  practical  value  in  sorting  through  their  associative  issues 
sooner  rather  than  later. 


privacy  violations,  piracy,  viruses,  and  other  ills;  yet  no  one  suggests  that  we  should  do  away  with  cyberspace  [e.g., 
Weckert,  2007]. 
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Fourth  and  finally,  while  our  investigation  here  is  supported  by  the  US  Department  of  the  Navy, 
Office  of  Naval  Research,  it  may  apply  equally  well  to  other  branches  of  military  service,  all  of  which 
are  also  developing  robotics  for  their  respective  needs.  The  range  of  robotics  deployed  or  under 
consideration  by  the  Navy,  however,  is  exceptionally  broad,  with  airborne,  sea  surface,  underwater, 
and  ground  applications.^  Thus,  it  is  particularly  fitting  for  the  Department  of  the  Navy  to  support 
one  of  the  first  dedicated  investigations  on  the  risk  and  ethical  issues  arising  from  the  use  of 
autonomous  military  robotics. 


1.2  Definitions 


To  the  extent  that  there  are  no  standard,  universally-accepted  definitions  of  some  of  the  key  terms 
we  employ  in  this  report,  we  will  need  to  stipulate  those  working  definitions  here,  since  it  is 
important  that  we  ensure  we  have  the  same  basic  understanding  of  those  terms  at  the  outset.  And 
so  that  we  do  not  become  mired  in  debating  precise  definitions  here,  we  provide  a  detailed 
discussion  or  justification  for  our  definitions  in  'Appendix  A:  Definitions'. 

Robot  (particularly  in  a  military  context).  A  powered  machine  that  (1)  senses,  (2)  thinks  (in  a 
deliberative,  non-mechonicol  sense),  and  (3)  acts. 

Most  robots  are  and  will  be  mobile,  such  as  vehicles,  but  this  is  not  an  essential  feature;  however, 
some  degree  of  mobility  is  required,  e.g.,  a  fixed  sentry  robot  with  swiveling  turrets  or  a  stationary 
industrial  robot  with  movable  arms.  Most  do  not  and  will  not  carry  human  operators,  but  this  too  is 
not  an  essential  feature;  the  distinction  becomes  even  more  blurred  as  robotic  features  are 
integrated  with  the  body.  Robots  can  be  operated  semi-  or  fully-autonomously  but  cannot  depend 
entirely  on  human  control:  for  instance,  tele-operated  drones  such  as  the  Air  Force's  Predator 
unmanned  aerial  vehicle  would  qualify  as  robots  to  the  extent  that  they  make  some  decisions  on 
their  own,  such  as  navigation,  but  a  child's  toy  car  tethered  to  a  remote  control  is  not  a  robot  since 
its  control  depends  entirely  on  the  operator.  Robots  can  be  expendable  or  recoverable,  and  can 
carry  a  lethal  or  non-lethal  payload.  And  robots  can  be  considered  as  agents,  i.e.,  they  have  the 
capacity  to  act  In  a  world,  and  some  even  may  be  moral  agents,  as  discussed  in  the  next  definition. 

Autonomy  (in  machines).  The  capacity  to  operate  in  the  real-world  environment  without  any  form  of 
external  control,  once  the  machine  is  activated  and  at  least  in  some  areas  of  operation,  for  extended 
periods  of  time. 

This  is  to  say  that,  we  are  herein  not  interested  in  issues  traditionally  linked  to  autonomy  that 
require  a  more  robust  and  precise  definition,  such  as  the  assignment  of  political  rights  and  moral 

^  The  only  applications  not  covered  by  the  Department  of  the  Navy  appear  to  be  underground-  and  space-based, 
including  sub-orbital  missions,  which  may  understandably  fall  outside  their  purview. 
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responsibility  (as  different  from  legal  responsibility)  or  even  more  technical  issues  related  to  free 
will,  determinism,  personhood,  and  whether  machines  can  even  'think'— as  important  as  those 
issues  are  in  philosophy,  law,  and  ethics.  But  in  the  interest  of  simplicity,  we  will  stipulate  this 
definition,  which  seems  acceptable  in  a  discussion  limited  to  human-created  machines.  This  term 
also  helps  elucidate  the  second  criterion  of  'thinking'  in  our  working  definition  of  a  robot.  Autonomy 
is  also  related  to  the  concept  of  moral  agency,  i.e.,  the  ability  to  make  moral  judgments  and  choose 
one's  actions  accordingly. 

Ethics  (construed  broadly  for  this  report).  More  than  normative  issues,  i.e.,  questions  about  what  we 
should  or  ought  to  do,  but  olso  general  concerns  related  to  social,  political,  and  cultural  impact  os 
well  os  risk  arising  from  the  use  of  robotics. 

As  a  result,  we  will  cover  all  these  areas  in  our  report,  not  just  philosophical  questions  or  ethical 
theory,  with  the  goal  of  providing  some  relevant  if  not  actionable  insights  at  this  preliminary  stage. 
We  will  also  discuss  relevant  ethical  theories  in  more  detail  in  section  3  (though  this  is  not  meant  to 
be  a  comprehensive  treatment  of  the  subject). 


1.3  Market  Forces  and  Considerations 


Several  industry  trends  and  recent  developments— including  high-profile  failures  of  semi- 
autonomous  systems,  as  perhaps  a  harbinger  of  challenges  with  more  advanced  systems— highlight 
the  need  for  a  technology  risk  assessment,  as  well  as  a  broader  study  of  other  ethical  and  social 
issues  related  to  the  field.  In  the  following,  we  will  briefly  discuss  seven  primary  market  forces  that 
are  driving  the  development  of  military  robotics  as  well  as  the  need  for  a  guiding  ethics;  these 
roughly  map  to  what  have  been  called  'push'  (technology)  and  'pull'  (social  and  cultural)  factors  [US 
Department  of  Defense,  2007,  p.44]. 

1.  Compelling  military  utility.  US  defense  organizations  are  attracted  to  the  use  of  robots  for  a 
"ange  of  benefits,  some  of  which  we  have  mentioned  above.  A  primary  reason  is  to  replace  us 
ess-durable  humans  in  "dull,  dirty,  and  dangerous"  jobs  [US  Department  of  Defense,  2007, 
0.19].  This  Includes:  extended  reconnaissance  missions,  which  stretch  the  limits  of  human 
endurance  to  its  breaking  point;  environmental  sampling  after  a  nuclear  or  biochemical  attack, 
which  had  previously  led  to  deaths  and  long-term  effects  on  the  surveying  teams;  and 
neutralizing  lEDs,  which  have  caused  over  40%  of  US  casualties  in  Iraq  since  2003  [Iraq  Coalition 
Casualty  Count,  2008).  While  official  statistics  are  difficult  to  locate,  news  organizations  report 
that  the  US  has  deployed  over  5,000  robots  in  Iraq  and  Afghanistan,  which  have  neutralized 
10,000  lEDs  by  2007  [CBS,  2007]. 
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Also  mentioned  above,  military  robots  may  be  more  discriminating,  efficient,  and  effective. 
Their  dispassionate  and  detached  approach  to  their  work  could  significantly  reduce  the  instances 
of  unethical  behavior  in  wartime-abuses  that  negatively  color  the  US  prosecution  of  a  conflict, 
no  matter  how  just  the  initial  reasons  to  enter  the  conflict  are,  and  carry  a  high  political  cost. 

2.  US  Congressional  deadlines.  Clearly,  there  is  a  tremendous  advantage  to  employing  robots  on 
the  battlefield,  and  the  US  government  recognizes  this.  Two  key  Congressional  mandates  are 
driving  the  use  of  military  robotics:  by  2010,  one-third  of  all  operational  deep-strike  aircraft  must 
be  unmanned,  and  by  2015,  one-third  of  all  ground  combat  vehicles  must  be  unmanned 
[National  Defense  Authorization  Act,  2000].  Most,  if  not  all,  of  the  robotics  in  use  and  under 
development  are  semi-autonomous  at  best;  and  though  the  technology  to  (responsibly)  create 
fully  autonomous  robots  is  near  but  not  quite  in  hand,  we  would  expect  the  US  Department  of 
Defense  to  adopt  the  same,  sensible  'crawl-walk-run'  approach  as  with  weaponized  systems, 
given  the  serious  inherent  risks. 

Nonetheless,  these  deadlines  apply  increasing  pressure  to  develop  and  deploy  robotics, 
including  autonomous  vehicles;  yet  a  'rush  to  market'  increases  the  risk  for  inadequate  design  or 
programming.  Worse,  without  a  sustained  and  significant  effort  to  build  in  ethical  controls  in 
autonomous  systems,  or  even  to  discuss  the  relevant  areas  of  ethics  and  risk,  there  is  little  hope 
that  the  early  generations  of  such  systems  and  robots  will  be  adequate,  making  mistakes  that 
may  cost  human  lives.  (This  is  related  to  the  'first-generation'  problem  we  discuss  in  sections  6 
and  7,  that  we  won't  know  exactly  what  kind  of  errors  and  mistaken  harms  autonomous  robots 
will  commit  until  they  have  already  done  so.) 

3.  Continuing  unethical  battlefield  conduct.  Beyond  popular  news  reports  and  images  of 
purportedly  unethical  behavior  by  human  soldiers,  the  US  Army  Surgeon  General's  Office  had 
surveyed  US  troops  in  Iraq  on  issues  in  battlefield  ethics  and  discovered  worrisome  results. 
From  its  summary  of  findings,  among  other  statistics:  "Less  than  half  of  Soldiers  and  Marines 
believed  that  non-combatants  should  be  treated  with  respect  and  dignity  and  well  over  a  third 
believed  that  torture  should  be  allowed  to  save  the  life  of  a  fellow  team  member.  About  10%  of 
Soldiers  and  Marines  reported  mistreating  an  Iraqi  non-combatant  when  it  wasn't 
necessary.. .Less  than  half  of  Soldiers  and  Marines  would  report  a  team  member  for  unethical 
behavior.. .Although  reporting  ethical  training,  nearly  a  third  of  Soldiers  and  Marines  reported 
encountering  ethical  situations  in  Iraq  in  which  they  didn't  know  how  to  respond"  [US  Army 
Surgeon  General's  Office,  2006].  The  most  recent  survey  by  the  same  organization  reported 
similar  results  [US  Army  Surgeon  General's  Office,  2008]. 

Wartime  atrocities  have  occurred  since  the  beginning  of  human  history,  so  we  are  not  operating 
under  the  illusion  that  they  can  be  eliminated  altogether  (nor  that  armed  conflicts  can  be 
eliminated  either,  at  least  in  the  foreseeable  future).  However,  to  the  extent  that  military  robots 
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can  considerably  reduce  unethical  conduct  on  the  battlefield— greatly  reducing  human  and 
political  costs— there  is  a  compelling  reason  to  pursue  their  development  as  well  as  to  study 
their  capacity  to  act  ethically. 

4.  Military  robotics  failures.  More  than  theoretical  problems,  military  robotics  have  already  failed 
on  the  battlefield,  creating  concerns  with  their  deployment  (and  perhaps  even  more  concern  for 
more  advanced,  complicated  systems)  that  ought  to  be  addressed  before  speculation, 
incomplete  information,  and  hype  fill  the  gap  in  public  dialogue. 

In  April  2008,  several  TALON  SWORDS  units— mobile  robots  armed  with  machine  guns— in  Iraq 
were  reported  to  be  grounded  for  reasons  not  fully  disclosed,  though  early  reports  claim  the 
robots,  without  being  commanded  to,  trained  their  guns  on  'friendly'  soldiers  [e.g..  Page,  2008]; 
and  later  reports  denied  this  account  but  admitted  there  had  been  malfunctions  during  the 
development  and  testing  phase  prior  to  deployment  [e.g.,  Sofge,  2008].  The  full  story  does  not 
appear  to  have  yet  emerged,  but  either  way,  the  incident  underscores  the  public's  anxiety— and 
the  military's  sensitivity— with  the  use  of  robotics  on  the  battlefield  (also  see  'Public  perceptions' 
below). 

Further,  it  is  not  Implausible  to  suggest  that  these  robots  may  fail,  because  it  has  already 
happened  elsewhere:  in  October  2007,  a  semi-autonomous  robotic  cannon  deployed  by  the 
South  African  army  malfunctioned,  killing  nine  'friendly'  soldiers  and  wounding  14  others  [e.g., 
Shachtman,  2007].  Communication  failures  and  errors  have  been  blamed  for  several  unmanned 
aerial  vehicle  (UAV)  crashes,  from  those  owned  by  the  Sri  Lanka  Air  Force  to  the  US  Border  Patrol 
|e.g.,  BBC,  2005;  National  Transportation  Safety  Board,  2007].  Computer-related  technology  in 
general  is  especially  susceptible  to  malfunctions  and  'bugs'  given  their  complexity  and  even  after 
many  generations  of  a  product  cycle;  thus,  it  is  reasonable  to  expect  similar  challenges  with 
robotics. 

5.  Related  civilian  systems  failures.  On  a  similar  technology  path  as  autonomous  robots,  civilian 
computer  systems  have  failed  and  raised  worries  that  can  carry  over  to  military  applications.  For 
instance,  such  civilian  systems  have  been  blamed  for  massive  power  outages:  in  early  2008, 
F  lorida  suffered  through  massive  blackouts  across  the  entire  state,  as  utility  computer  systems 
automatically  shut  off  and  rerouted  power  after  just  a  small  fire  caused  by  a  failed  switch  at  one 
electrical  substation  [e.g.,  Padgett,  2008];  and  in  the  summer  2003,  a  single  fallen  tree  had 
triggered  a  tsunami  of  cascading  computer-initiated  blackouts  that  affected  tens  of  millions  of 
customers  for  days  and  weeks  across  the  eastern  US  and  Canada,  leaving  practically  no  time  for 
human  intervention  to  fix  what  should  have  been  a  simple  problem  of  stopping  the  disastrous 
chain  reaction  [e.g.,  US  Department  of  Energy,  2004).  Thus,  it  is  a  concern  that  we  also  may  not 
be  able  to  halt  some  (potentlally-fatal)  chain  of  events  caused  by  autonomous  military  systems 
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that  process  information  and  can  act  at  speeds  incomprehensible  to  us,  e.g.,  with  high-speed 
unmanned  aerial  vehicles. 

Further,  civilian  robotics  are  becoming  more  pervasive.  Never  mind  seemingly-harmless 
entertainment  robots,  some  major  cities  (e.g.,  Atlanta,  London,  Paris,  Copenhagen)  already 
boast  driverless  transportation  systems,  again  creating  potential  worries  and  ethical  dilemmas 
(e.g.,  bringing  to  life  the  famous  thought-experiment  in  philosophy:  should  a  fast-moving  train 
divert  itself  to  another  track  in  order  to  kill  only  one  innocent  person,  or  continue  forward  to  kill 
the  five  on  its  current  path?).  So  there  can  be  lessons  for  military  robotics  that  can  be 
transferred  from  civilian  robotics  and  automated  decision-making,  and  vice  versa.  Also,  as 
robots  become  more  pervasive  in  the  public  marketplace— they  are  already  abundant  in 
manufacturing  and  other  industries— the  broader  public  will  become  more  aware  of  risk  and 
ethical  issues  associated  with  such  innovations,  concerns  that  inevitably  will  carry  over  to  the 
military's  use. 

6.  Complexity  and  unpredictability.  Perhaps  robot  ethics  has  not  received  the  attention  it  needs,  at 
least  in  the  US,  given  a  common  misconception  that  robots  will  do  only  what  we  have 
programmed  them  to  do.  Unfortunately,  such  a  belief  is  a  sorely  outdated,  harking  back  to  a 
time  when  computers  were  simpler  and  their  programs  could  be  written  and  understood  by  a 
single  person.  Now,  programs  with  millions  of  lines  of  code  are  written  by  teams  of 
programmers,  none  of  whom  knows  the  entire  program;  hence,  no  individual  can  predict  the 
effect  of  a  given  command  with  absolute  certainty,  since  portions  of  large  programs  may  interact 
in  unexpected,  untested  ways.  (And  even  straightforward,  simple  rules  such  as  Asimov's  Laws  of 
Robotics  can  create  unexpected  dilemmas  [e.g.,  Asimov,  1950].)  Furthermore,  increasing 
complexity  may  lead  to  emergent  behaviors,  i.e.,  behaviors  not  programmed  but  arising  out  of 
sheer  complexity  [e.g.,  Kurzweil,  1999,  2005]. 

Related  major  research  efforts  also  are  being  devoted  to  enabling  robots  to  learn  from 
experience,  raising  the  question  of  whether  we  predict  with  reasonable  certainty  what  the  robot 
will  learn.  The  answer  seems  to  be  negative,  since  if  we  could  predict  that,  we  would  simply 
program  the  robot  in  the  first  place,  instead  of  requiring  learning.  Learning  may  enable  the 
robot  to  respond  to  novel  situations,  given  the  impracticality  and  impossibility  of  predicting  all 
eventualities  on  the  designer's  part.  Thus,  unpredictability  in  the  behavior  of  complex  robots  Is  a 
major  source  of  worry,  especially  if  robots  are  to  operate  in  unstructured  environments,  rather 
than  the  carefully-structured  domain  of  a  factory.  (We  will  discuss  machine  learning  further  in 
sections  2  and  3.) 

7.  Public  perceptions.  From  Asimov's  science  fiction  novels  to  Hollywood  movies  such  as  Wall-E, 
Iron  Man,  Transformers,  Blade  Runner,  Star  Wars,  Terminator,  Robocop,  2001:  A  Space  Odyssey, 
and  I,  Robot  (to  name  only  a  few,  from  the  iconic  to  recently  released),  robots  have  captured  the 
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global  public's  imagination  for  decades  now.  But  in  nearly  every  one  of  those  works,  the  use  of 
robots  in  society  is  in  tension  with  ethics  and  even  the  survival  of  humankind.  The  public,  then, 
is  already  sensitive  to  the  risks  posed  by  robots— whether  or  not  those  concerns  are  actually 
justified  or  plausible— to  a  degree  unprecedented  in  science  and  technology.  Now,  technical 
advances  in  robotics  is  catching  up  to  literary  and  theatrical  accounts,  so  the  seeds  of  worry  that 
have  long  been  planted  in  the  public  consciousness  will  grow  into  close  scrutiny  of  the  robotics 
industry  with  respect  to  those  ethical  issues,  e.g.,  the  book  Love  and  Sex  with  Robots  published 
late  last  year  that  reasonably  anticipates  human-robot  relationships  [Levy,  2007]. 

Given  such  investments,  questions,  events,  and  predictions,  it  is  no  wonder  that  more  attention  is 
being  paid  to  robot  ethics,  particularly  in  Europe  [e.g.,  Veruggio,  2007].  An  entire  conference 
dedicated  to  the  Issue  of  ethics  in  autonomous  military  systems— one  of  the  first  we  have  seen,  if 
not  the  first  of  its  kind— was  held  in  late  February  2008  in  the  UK  [Royal  United  Services  Institute 
(RUSI)  for  Defence  and  Security  Studies,  2008],  in  which  experts  reiterated  the  possibility  that  robots 
might  commit  war  crimes  or  be  turned  on  us  by  terrorists  and  criminals  [RUSI,  2008:  Noel  Sharkey 
and  Rear  Admiral  Chris  Parry's  presentations,  respectively;  also,  Sharkey,  2007a,  and  Asaro,  2008]. 
Robotics  is  a  particularly  thriving  and  advanced  industry  in  Asia:  South  Korea  Is  the  first  (and  still 
only?)  nation  to  be  working  on  a  'Robot  Ethics  Charter'  or  a  code  of  ethics  to  govern  responsible 
robotics  development  and  use,  though  the  document  has  yet  to  materialize  [BBC,  2007].  This 
summer,  Taiwan  played  host  to  a  conference  about  advanced  robotics  and  its  societal  impacts 
[Institute  of  Electrical  and  Electronics  Engineers  (IEEE),  2008]. 

But  the  US  Is  starting  to  catch  up:  some  notable  US  experts  are  working  on  similar  issues,  which  we 
will  discuss  throughout  this  report  [Arkin,  2007;  Wallach  and  Allen,  2008].  A  January  2008 
conference  at  Stanford  University  focused  on  technology  in  wartime,  of  which  robot  ethics  was  one 
notable  session  [Computer  Professionals  for  Social  Responsibility  (CPSR),  2008].  In  July  2008,  the 
North  American  Computing  and  Philosophy  (NA-CAP)  conference  at  Indiana  University  focused  a 
significant  part  of  its  program  on  robot  ethics  [NA-CAP,  2008].  Again,  we  intend  for  this  report  as  an 
early,  complementary  step  in  filling  the  gap  in  robot-ethics  research,  both  technical  and  theoretical. 
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1.4  Report  Overview 


Following  this  introduction,  in  section  2,  we  will  provide  a  short  background  discussion  on  robotics  in 
general  and  in  defense  applications  specifically.  We  will  survey  briefly  the  current  state  of  robotics  in 
the  military  as  well  as  developments  in  progress  and  anticipated.  This  includes  several  future 
scenarios  in  which  the  military  may  employ  autonomous  robots,  which  will  help  anchor  and  add 
depth  to  our  discussions  later  on  ethics  and  risk. 

In  section  3,  we  will  discuss  the  possibility  of  programming  In  rules  or  a  framework  in  robots  to 
govern  their  actions  (such  as  Asimov's  Laws  of  Robotics).  There  are  different  programming 
approaches:  top-down,  bottom-up,  and  a  hybrid  approach  [Wallach  and  Allen,  2008].  We  also 
discuss  the  major  (competing)  ethical  theories— deontology,  consequentialism,  and  virtue  ethics— 
that  these  approaches  correspond  with  as  well  as  their  limitations. 

In  section  4,  we  consider  an  alternative,  as  well  as  a  complementary  approach,  to  programming  a 
robot  with  an  ethical  behavior  framework:  to  simply  program  it  to  obey  the  relevant  Laws  of  War 
and  Rules  of  Engagement.  To  that  end,  we  also  discuss  the  relevant  LOW  and  ROE,  including  a 
discussion  of  just-war  theory  and  related  Issues  that  may  arise  in  the  context  of  autonomous  robots. 

In  section  5,  continuing  the  discussion  about  law,  we  will  also  look  at  the  issue  of  legal  responsibility 
based  on  precedents  related  to  product  liability,  negligence  and  other  areas  [Asaro,  2007].  This  at 
least  informs  questions  of  risk  in  the  near-  and  mid-term  in  which  robots  are  essentially  human- 
made  tools  and  not  moral  agents  of  their  own;  but  we  also  look  at  the  case  for  treating  robots  as 
quasi-legal  agents. 

In  section  6,  we  will  broaden  our  discussion  in  providing  a  framework  for  technology  risk  assessment. 
This  framework  includes  a  discussion  of  the  major  factors  in  determining  'acceptable  risk':  consent, 
informed  consent,  affected  population,  seriousness,  and  probability  [DesJardins,  2003]. 

In  section  7,  we  will  bring  the  various  ethics  and  social  issues  discussed,  and  new  ones,  together  in 
one  location.  We  will  survey  a  full  range  of  possible  risks  and  issues  related  to  ethics,  just-war 
theory,  technical  challenges,  societal  impact,  and  more.  These  contingencies  and  issues  are 
important  to  have  in  mind  in  any  complete  assessment  of  technology  risks. 

Finally,  in  section  8,  we  will  draw  some  preliminary  conclusions,  including  recommendations  for 
future,  more  detailed  investigations.  A  bibliography  is  provided  as  section  9  of  the  report;  and 
appendix  A  offers  more  detailed  discussions  on  key  definitions,  as  initiated  in  this  section. 
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2.  Military  Robotics 


The  field  of  robotics  has  changed  dramatically  during  the  past  30  years.  While  the  first 
programmable  articulated  arms  for  industrial  automation  were  developed  by  George  Devol  and 
made  into  commercial  products  by  Joseph  Engleberger  in  the  1960s  and  1970S;  mobile  robots  with 
various  degrees  of  autonomy  did  not  receive  much  attention  until  the  1970s  and  1980s.  The  first 
true  mobile  robots  arguably  were  Elmer  and  Elsie,  the  electromechanical  'tortoises'  made  by  W.  Grey 
Walter,  a  physiologist,  in  1950  [Walter,  1950].  These  remarkable  little  wheeled  machines  had  many 
of  the  features  of  contemporary  robots:  sensors  (photocells  for  seeking  light  and  bumpers  for 
obstacle  detection),  a  motor  drive  and  built-in  behaviors  that  enabled  them  to  seek  (or  avoid)  light, 
wander,  avoid  obstacles  and  recharge  their  batteries.  Their  architecture  was  basically  reactive,  in 
that  a  stimulus  directly  produced  a  response  without  any  'thinking.'  That  development  first 
appeared  in  Shakey,  a  robot  constructed  at  Stanford  Research  Laboratories  in  1969  [Pikes  and 
Nilsson,  1971].  In  this  machine,  the  sensors  were  not  directly  coupled  to  the  drive  motors  but 
provided  inputs  to  a  'thinking'  layer  known  as  the  Stanford  Research  Institute  Problem  Solver 
(STRIPS),  one  of  the  earliest  applications  of  artificial  intelligence.  The  architecture  was  known  as 
'sense-plan-act'  or  'sense-think-act'  [Arkin,  1998]. 

Since  those  early  developments,  there  have  been  major  strides  in  mobile  robots— made  possible  by 
new  materials,  faster,  smaller  and  cheaper  computers  (Moore's  law)  and  major  advances  in 
software.  At  present,  robots  move  on  land,  in  the  water,  in  the  air,  and  in  space.  Terrestrial  mobility 
uses  legs,  treads,  and  wheels  as  well  as  snake-like  locomotion  and  hopping.  Flying  robots  make  use 
of  propellers,  jet  engines,  and  wings.  Underwater  robots  may  resemble  submarines,  fish,  eels,  or 
even  lobsters.  Some  vehicles  capable  of  moving  in  more  than  one  medium  or  terrain  have  been 
built.  Service  robots,  designed  for  such  applications  as  vacuum  cleaning,  floor  washing  and  lawn 
mowing,  have  been  sold  in  large  quantities  in  recent  years.  Humanoid  robots,  long  considered  only 
in  science  fiction  novels,  are  now  manufactured  in  various  sizes  and  with  various  degrees  of 
sophistication  [Bekey,  2005].  Small  toy  humanoids,  such  as  the  WowWee  Corporation's  RoboSapien, 
have  been  sold  in  quantities  of  millions.  More  complex  humanoids,  such  as  the  Honda  ASIMO  are 
able  to  perform  numerous  tasks.  However,  'killer  applications'  for  humanoid  robots  have  not  yet 
emerged. 

There  has  also  been  great  progress  In  the  development  of  software  for  robots,  including  such 
applications  as  learning,  interaction  with  humans,  multiple  robot  cooperation,  localization  and 
navigation  in  noisy  environments,  and  simulated  emotions.  We  discuss  some  of  these  developments 
briefly  in  section  2.6  below. 


290 


NOOO 14-07-1- 1152 


P.I. Susan  C.  Opava,  Ph.D. 


During  the  past  20  years,  military  robotic  vehicles  have  been  built  using  all  the  modes  of  locomotion 
described  above  and  making  use  of  the  new  software  paradigms  [US  Dept.  Of  Defense,  2007]. 
Military  robots  find  major  applications  in  surveillance,  reconnaissance,  location  and  destruction  of 
mines  and  lEDs,  as  well  as  for  offense  or  attack.  The  latter  class  of  vehicles  is  equipped  with 
weapons,  which  at  the  present  time  are  fired  by  remote  human  controllers.  In  the  following,  we  first 
summarize  the  state  of  the  art  in  military  robots,  including  both  hardware  and  software,  and  then 
introduce  some  of  the  ethical  issues  which  arise  from  their  use.  We  concentrate  on  robots  capable 
of  lethal  action— in  that  much  of  the  concern  with  military  robotics  is  tied  to  this  lethality— and  omit 
discussion  of  more  innocuous  machines  such  as  the  Army's  Big  Dog,  a  four  legged  robot  capable  of 
carrying  several  hundred  pounds  of  cargo  over  irregular  terrain.  If  at  some  future  time  such  'carry 
robots'  are  equipped  with  weapons,  they  may  need  to  be  considered  from  an  ethical  point  of  view. 


2.1  Ground  Robots 


The  US  Army  makes  use  of  two  major  types  of  autonomous  and  semi-autonomous  ground  vehicles: 
large  vehicles,  such  as  tanks,  trucks  and  HUMVEEs  and  small  vehicles,  which  may  be  carried  by  a 
soldier  in  a  backpack  (such  as  the  PackBot  shown  in  Fig,  2,0a)  and  move  on  treads  like  small  tanks 
[US  Dept.  Of  Defense,  2007].  The  PackBot  is  equipped  with  cameras  and  communication  equipment 
and  may  include  manipulators  (arms);  it  is  designed  to  find  and  detonate  lEDs,  thus  saving  lives  (both 
civilian  and  military),  as  well  as  to  perform  reconnaissance.  Its  small  size  enables  it  to  enter 
buildings,  report  on  possible  occupants,  and  trigger  booby  traps.  Typical  armed  robot  vehicles  are 
(1)  the  Talon  SWORDS  (Special  Weapons  Observation  Reconnaissance  Detection  System)  made  by 
Foster-Miller,  which  can  be  equipped  with  machine  guns,  grenade  launchers,  or  anti-tank  rocket 
launchers  as  well  as  cameras  and  other  sensors  (see  Fig.  2,0b)  and  (2)  the  newer  MAARS  (Modular 
Advanced  Armed  Robotic  System).  While  vehicles  such  as  SWORDS  and  the  newer  MAARS  are  able 
to  autonomously  navigate  toward  specific  targets  through  its  global  positioning  system  (GPS),  at 
present  the  firing  of  any  on-board  weapons  is  done  by  a  soldier  located  a  safe  distance  away.  Foster- 
Miller  provides  a  universal  control  module  for  use  by  the  warfighter  with  any  of  their  robots.  MAARS 
uses  a  more  powerful  machine  gun  than  the  original  SWORDS.  While  the  original  SWORDS  weighted 
about  150  lbs.,  MAARS  weighs  about  350  lbs.  It  is  equipped  with  a  new  manipulator  capable  of 
lifting  100  lbs.,  thus  enabling  it  to  replace  its  weapon  platform  with  an  lED  identification  and 
neutralization  unit. 

Among  the  larger  vehicles,  the  Army's  Tank-Automotive  Research,  Development  and  Engineering 
Center  (jointly  with  Foster-Miller)  has  developed  the  TAGS-CX,  a  5,000-6,000  lb.  amphibious  vehicle. 
More  recently,  and  jointly  with  Carnegie  Mellon  University,  the  Army  has  developed  a  5.5  ton,  six- 
wheel  unmanned  vehicle  known  as  the  Crusher,  capable  of  carrying  2,000  lbs.  at  about  30  mph  and 
capable  of  withstanding  a  mine  explosion;  it  is  equipped  with  one  or  more  guns  (see  figure  2.1). 


291 


NOOO 14-07-1-1 152 


P.l. Susan  C.  Opava.  Ph.D. 


(a)  (b) 

Fig.  2.0  Military  ground  vehicles:  (a)  PackBot  (Courtesy  ofiRobot  Corp.); 
(b)  SWORDS  (Courtesy  of  Foster^Miller  Corp.) 


Fig.  2.1  Military  ground  vehicle:  The  Crusher  (Courtesy  of  US  Army) 

Both  PackBot  and  Talon  robots  are  being  used  extensively  and  successfully  in  Iraq  and  Afghanistan. 
Hence,  we  expect  further  announcements  of  UGV  deployments  in  the  near  future.  We  are  not 
aware  of  the  use  of  armed  sentry  robots  by  the  US  military;  however,  they  are  used  in  South  Korea 
(developed  by  Samsung)  and  in  Israel.  The  South  Korean  system  is  capable  of  interrogating  suspects, 
identifying  potential  enemy  intruders,  and  autonomous  firing  of  its  weapon. 
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DARPA  supported  two  major  national  competitions  leading  to  the  development  of  autonomous 
ground  vehicles.  The  2005  Grand  Challenge  required  autonomous  vehicles  to  traverse  portions  of 
the  Mojave  desert  in  California.  The  vehicles  were  provided  with  GPS  coordinates  of  way-points 
along  the  route,  but  otherwise  the  terrain  to  be  traversed  was  completely  unknown  to  the  designers, 
and  the  vehicles  moved  autonomously  at  speed  averaging  20  to  30  mph.  In  2007,  the  Urban 
Challenge  required  autonomous  vehicles  to  move  in  a  simulated  urban  environment,  in  the  presence 
of  other  vehicles  and  signal  lights,  while  obeying  traffic  laws.  While  the  winning  automobiles  from 
Stanford  University  and  Carnegie  Mellon  University  were  not  military  in  nature,  the  lessons  learned 
will  undoubtedly  find  their  way  into  future  generations  of  autonomous  robotic  vehicles  developed  by 
the  Army  and  other  services. 


2.2  Aerial  Robots 


The  US  Army,  Air  Force,  and  Navy  have  developed  a  variety  of  robotic  aircraft  known  as  unmanned 
flying  vehicles  (UAVs).^  Like  the  ground  vehicles,  these  robots  have  dual  applications:  they  can  be 
used  for  reconnaissance  without  endangering  human  pilots,  and  they  can  carry  missiles  and  other 
weapons.  The  services  use  hundreds  of  unarmed  drones,  some  as  small  as  a  model  aiplane,  to  locate 
and  identify  enemy  targets.  An  important  function  for  unarmed  UAVs  is  to  serve  as  aerial  targets  for 
piloted  aircraft,  such  as  those  manufactured  by  AeroMech  Engineering  in  San  Luis  Obispo,  CA,  a 
company  started  by  Cal  Poly  students.  AeroMech  has  sold  some  750  UAVs,  ranging  from  4  lb. 
battery-operated  ones  to  150  lb.  vehicles  with  jet  engines.  Some  reconnaissance  UAVs,  such  as  the 
Shadow,  are  launched  by  a  catapult  and  can  stay  aloft  all  day.  The  best  known  armed  UAVs  are  the 
semi-autonomous  Predator  Unmanned  Combat  Air  Vehicles  (UCAV)  built  by  General  Atomics  (see 
Fig.  2.2a),  which  can  be  equipped  with  Hellfire  missiles.  Both  the  Predator  and  the  larger  Reaper 
hunter-killer  aircraft  are  used  extensively  in  Afghanistan.  They  can  navigate  autonomously  toward 
targets  specified  by  GPS  coordinates,  but  a  remote  operator  located  in  Nevada  (or  in  Germany) 
makes  the  final  decision  to  release  the  missiles.  The  Navy,  jointly  with  Northrop  Grumman,  is 
developing  an  unmanned  bomber  with  folding  wings  which  can  be  launched  from  an  aircraft  carrier. 

The  military  services  are  also  developing  very  small  aircraft,  sometimes  called  Micro  Air  Vehicles 
(MAV)  capable  of  carrying  a  camera  and  sending  images  back  to  their  base.  An  example  is  the  Micro 
Autonomous  Air  Vehicle  (MAAV;  also  called  MUAV  for  Micro  Unmanned  Air  Vehicle)  developed  by 
Intelligent  Automation,  Inc.,  which  is  not  much  larger  than  a  human  hand  (see  Fig.  2.2b). 


^  Earlier  versions  of  such  vehicles  were  termed  'drones',  which  implied  that  they  were  completely  under  control  of  a 
pilot  in  a  chaser  aircraft.  Current  models  are  highly  autonomous,  receiving  destination  coordinates  from  only  ground 
or  satellite  transmitters.  Thus,  because  this  report  is  focused  on  robots— machines  that  have  some  degree  of 
autonomy— we  do  not  use  the  term  'drone'  here. 
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(a)  (b) 

Fig.  2.2  Autonomous  oircroft:  (o)  Predotor  (Courtesy  of  Generol  Atomics  Aeronouticol  Systems); 
(b)  Micro  unmonned  flying  vehicle  (Courtesy  of  Intelligent  Automation,  Inc.) 


Similarly,  the  University  of  Florida  has  developed  an  MAV  with  a  16-inch  wingspan  with  foldable 
wings,  which  can  be  stored  in  an  8-inch  x  4-inch  container.  Other  AUVs  include  a  ducted  fan  vehicle 
(see  Fig.  2.3a)  being  used  in  Iraq,  and  vehicles  with  flapping  wings,  made  by  AeroVironment  and 
others  (Fig.  2.3b).  While  MAVs  are  used  primarily  for  reconnaissance  and  are  not  equipped  with 
lethal  weapons,  it  is  conceivable  that  the  vehicle  itself  could  be  used  in  'suicide'  missions. 


(a)  (b) 


Fig.  2.3  Micro  oir  vehicles:  (o)  ducted  fon  vehicle  from  Honeywell;  (b)  Ornithopter  MAV  with  flopping 
wings  mode  by  students  ot  Brighom  Young  University  (Photo  byJoren  Wilkey/BYU,  used  by 

permission) 

Other  flying  robots  either  deployed  or  in  development,  including  helicopters,  tiny  robots  the  size  of  a 
bumblebee,  and  solar-powered  craft  capable  of  remaining  aloft  for  days  or  weeks  at  a  time.  Again, 
our  objective  here  is  not  to  provide  a  complete  survey,  but  to  indicate  the  wide  range  of  mobile 
robots  in  use  by  the  military  services. 
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2.3  Marine  Robots 


Along  with  the  other  services,  the  US  Navy  has  a  major  robotic  program  involving  interaction 
between  land,  airborne,  and  seaborne  vehicles  [US  Dept,  of  the  Navy,  2004;  US  Dept,  of  Defense, 
2007].  The  latter  include  surface  ships  as  well  as  Unmanned  Underwater  Vehicles  (UUVs).  Their 
applications  include  surveillance,  reconnaissance,  anti-submarine  warfare,  mine  detection  and 
clearing,  oceanography,  communications,  and  others.  It  should  be  noted  that  contemporary 
torpedoes  may  be  classified  as  UUVs,  since  they  possess  some  degree  of  autonomy. 

As  with  robots  in  the  other  services,  UUVs  come  in  various  sizes,  from  man-portable  to  very  large. 
Fig.  2.4a  shows  Boeing's  Long-term  Mine  Reconnaissance  System  (LMRS)  which  is  dropped  into  the 
ocean  from  a  telescoping  torpedo  launcher  aboard  the  SV  Ranger  to  begin  its  underwater 
surveillance  test  mission.  LMRS  uses  two  sonar  systems,  an  advanced  computer  and  its  own  inertial 
navigation  system  to  survey  the  ocean  floor  for  up  to  60  hours.  The  LMRS  shown  in  the  figure  is 
about  21  inches  in  diameter;  it  can  be  launched  from  a  torpedo  tube,  operate  autonomously,  return 
to  the  submarine,  and  be  guided  into  a  torpedo-tube  mounted  robotic  recovery  arm.  A  large  UUV, 
the  Seahorse,  is  shown  in  Fig.  2.4b;  this  vehicle  is  advertised  as  being  capable  of  'independent 
operations',  which  may  include  the  use  of  lethal  weapons.  The  Seahorse  is  about  3  feet  in  diameter, 
28  feet  long,  and  weighs  10,500  lbs.  The  Navy  plans  to  move  toward  deployment  of  large  UUVs  by 
2010.  These  vehicles  may  be  up  to  3  to  5  feet  in  diameter,  weighing  perhaps  20,000  lbs. 


(a)  (b) 

Figure  2.4:  (a)  Long-term  Mine  Reconnaissance  UUV  (Courtesy  of  The  Boeing  Company); 
(b)  Seahorse  3-foot  diameter  UUV  (Courtesy  of  Penn  State  University) 


Development  of  UUVs  Is  not  restricted  to  the  US.  Large  UUV  programs  exist  In  Australia,  Great 
Britain,  Sweden,  Italy,  Russia,  and  other  countries.  Fig.  2.5a  shows  a  UUV  made  in  Great  Britain  by 
BAE  Systems. 
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A  solar-powered  surface  vehicle  is  shown  in  Fig.  2.5b.  As  with  other  military  robots,  most  of  the 
vehicles  capable  of  delivering  deadly  force  are  currently  human-controlled  and  not  fully 
autonomous.  However,  the  need  for  autonomy  is  great  for  underwater  vehicles,  since  radio 
corrmunication  underwater  Is  difficult.  Many  UUVs  surface  periodically  to  send  and  receive 
messages. 


(a)  (b) 

Fig.  2.5:  (o)  Talisman  UUV  (Courtesy  of  BAE  Systems); 
(b)  Solar  powered  surface  vehicle  (Courtesy  ofNOAA) 


2.4  Space  Robots 


We  believe  that  the  US  Armed  Services  have  significant  programs  for  the  development  of 
autonomous  space  vehicles:  for  advanced  warning,  defense  against  attacking  missiles  and  possibly 
offensive  action  as  well.  However,  there  is  very  little  information  on  these  programs  in  publicly 
available  sources.  It  Is  clear  that  the  Air  Force  is  building  a  major  communication  system  in  space, 
named  Transformational  Satellite  Communication  System  (TSC).  This  system  will  interact  with 
airborne  as  well  as  ground-based  communication  nodes  to  create  a  truly  global  information  grid. 
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2.5  Immobile/Fixed  Robots 


To  this  point  we  have  described  a  range  of  mobile  robots  used  by  the  military:  on  earth,  on  and 
under  the  water,  in  the  air,  and  in  space.  It  should  be  noted  that  not  all  robots  capable  of  lethal 
action  are  mobile;  in  fact,  some  are  stationary,  with  only  limited  mobility  (such  as  aiming  of  a  gun). 
We  consider  a  few  examples  of  such  robots  in  this  section. 

First,  let  us  consider  again  why  land  mines  and  underwater  mines,  whether  aimed  at  destruction  of 
vehicles  or  attacks  on  humans  (anti-personnel  mines),  are  not  properly  robots.  Whether  buried  in 
the  ground  or  planted  in  the  surf  zone  along  the  ocean  shore,  these  systems  are  equipped  with  some 
sensing  ability  (since  they  can  detect  the  presence  of  weight),  and  they  'act'  by  exploding.  Their 
information  processing  ability  is  extremely  limited,  generally  consisting  only  of  a  switch  triggered  by 
pressure  from  above.  Given  our  definition  of  autonomous  robots  as  consider  in  section  1  (as  well  as 
detailed  in  Appendix  A),  while  such  mines  may  be  considered  as  autonomous,  we  do  not  classify 
them  as  robots  since  a  simple  trigger  is  not  equivalent  to  the  cognitive  functions  of  a  robot.  If  a 
landmine  is  considered  a  robot,  one  seems  to  be  absurdly  required  to  designate  a  trip  wire  as  a  robot 
too. 

On  the  other  hand,  there  are  immobile  or  stationary  weapons,  both  on  land  and  on  ships,  which  do 
merit  the  designation  of  robot,  despite  their  lack  of  mobility  (though  they  have  some  moving 
features,  which  satisfies  our  definition  for  what  counts  as  a  robot).  An  example  of  such  a  system  is 
the  Navy's  Phalanx  Close-In  Weapon  System  (CIWS).  CIWS  is  a  rapid-fire  20mm  gun  system  designed 
to  protect  ships  at  close  range  from  missiles  which  have  penetrated  other  defenses.  The  system  is 
mounted  on  the  deck  of  a  ship;  it  is  equipped  with  both  search  and  tracking  radars  and  the  ability  to 
rotate  a  turret  in  order  to  aim  the  guns.  The  information  processing  ability  of  the  computer  system 
associated  with  the  radars  is  remarkable,  since  it  automatically  performs  search,  detecting,  tracking, 
threat  evaluation,  firing,  and  kill-assessments  of  targets.  Thus,  the  CIWS  uses  radar  sensing  of 
approaching  missiles,  identifies  targets,  tracks  targets,  makes  the  decision  to  fire,  and  then  fires  its 
guns,  using  solid  tungsten  bullets  to  penetrate  the  approaching  target.  The  gun-and-radar  turret  can 
rotate  in  at  least  two  degrees  of  freedom  for  target  tracking,  but  the  entire  structure  is  immobile  and 
fixed  on  the  deck. 

The  US  Army  has  also  adopted  a  version  of  the  Phalanx  system  to  provide  close-in  protection  for 
troops  and  facilities  in  Iraq,  under  the  name  'Counter  Rocket,  Artillery,  and  Mortar'  (C-RAM,  or 
Counter-RAM).  The  system  is  mounted  on  the  ground  or,  in  some  cases,  on  a  train  platform.  The 
basic  system  operation  is  similar  to  that  of  the  Navy  system:  it  is  designed  to  destroy  incoming 
missiles  at  a  relatively  short  range.  However,  since  the  system  is  located  adjacent  to  or  near  civilian 
facilities,  there  is  major  concern  for  collateral  damage,  e.g.,  debris  or  fragments  of  a  disabled  missile 
could  land  on  civilians. 
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As  a  final  example  here,  we  cite  the  SGR-Al  sentry  robot  developed  by  Samsung  Techwin  Co.  for  use 
by  the  South  Korean  army  in  the  Demilitarized  Zone  (DMZ)  which  separates  North  and  South  Korea. 
The  system  is  stationary,  designed  to  replace  a  manned  sentry  location.  It  is  equipped  with 
sophisticated  color  vision  sensors  that  can  identify  a  person  entering  the  DMZ,  even  at  night  under 
only  starlight  illumination.  Since  any  person  entering  the  DMZ  is  automatically  presumed  to  be  an 
enemy.  It  Is  not  necessary  to  separate  friend  from  foe.  The  system  is  equipped  with  a  machine  gun, 
and  the  sensor-gun  assembly  is  capable  of  rotating  in  two  degrees  of  freedom  as  it  tracks  a  target. 
The  firing  of  the  gun  can  be  done  manually  by  a  soldier  or  by  the  robot  in  fully-automatic 
(autonomous)  mode. 


2.6  Robot  Software  Issues 


In  the  preceding,  we  have  presented  the  current  state  of  some  of  the  robotic  hardware  and  systems 
being  used  and/or  being  developed  by  the  military  services.  It  is  important  to  note  that  in  parallel 
with  the  design  and  fabrication  of  new  autonomous  or  semi-autonomous  robotic  systems,  there  is  a 
great  deal  of  work  on  fundamental  theoretical  and  software  implementation  Issues  which  also  must 
be  solved  if  fully  autonomous  systems  are  to  become  a  reality  [Bekey,  2005].  The  current  state  of 
some  of  these  issues  is  as  follows: 

2.6.1  Software  Architecture 

Most  current  systems  use  the  so-called  'three  level  architecture',  illustrated  in  Fig.  2.6.  The  lowest 
level  Is  basically  reflexive,  and  allows  the  robot  to  react  almost  instantly  to  a  particular  sensory  input. 


Figure  2.6.  Typical  three-level  architecture  for  robot  control 

The  highest  level,  sometimes  called  the  Deliberative  layer,  includes  Artificial  Intelligence  such  as 
planning  and  learning,  as  well  as  interaction  with  humans,  localization  and  navigation.  The 
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intermediate  or  'supervisory'  layer  provides  oversight  of  the  reactive  layer,  and  translates  upper 
level  commands  as  required  for  execution.  Many  recent  developments  have  concentrated  on 
increasing  the  sophistication  of  the  'deliberative'  layer. 

2.6.2  Simultoneous  Localization  and  Mopping  (SLAM) 

An  important  problem  for  autonomous  robots  is  to  ascertain  their  location  in  the  world  and  then  to 
generate  new  maps  as  they  move.  A  number  of  probabilistic  approaches  to  this  problem  have  been 
developed  recently. 

2.6.3  Learning 

Particularly  in  complex  situations  it  has  become  clear  that  robots  cannot  be  programmed  for  all 
eventualities.  This  Is  particularly  true  in  military  scenarios.  Hence,  the  robot  must  learn  the  proper 
responses  to  given  stimuli,  and  its  performance  should  improve  with  practice. 

2.6.4  Multiple  Robot  System  Architectures 

Increasingly,  it  will  become  necessary  to  deploy  multiple  robots  to  accomplish  dangerous  and 
complex  tasks.  The  proper  architecture  for  control  of  such  robot  groups  is  still  not  known.  For 
example,  should  they  be  organized  hierarchically,  along  military  lines,  or  should  they  operate  in 
semi-autonomous  sub-groups,  or  should  the  groups  be  totally  decentralized? 

2.6.5  Human-Robot  Interaction 

In  the  early  days  of  robotics  (and  even  today  in  certain  Industrial  applications),  robots  are  enclosed 
or  segregated  to  ensure  that  they  do  not  harm  humans.  However,  in  an  Increasing  number  of 
applications,  humans  and  robots  cooperate  and  perform  tasks  jointly.  This  is  currently  a  major  focus 
of  research  In  the  community,  and  there  are  several  international  conference  devoted  to  Human- 
Robot  Interaction  (HRI). 

2.6.6  Reconfiguroble  Systems 

There  is  increasing  interest  (both  for  military  and  civilian  applications)  In  developing  robots  capable 
of  some  form  of  'shape-shifting.'  Thus,  In  certain  scenarios,  a  robot  may  be  required  to  move  like  a 
snake,  while  In  others  it  may  need  legs  to  step  over  obstacles.  Several  labs  are  developing  such 
systems. 


2.7  Ethical  Implications:  A  Preview 
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It  is  evident  from  the  above  survey  that  the  Armed  Forces  of  the  United  States  are  implementing  the 
Congressional  mandate  described  in  section  1  of  this  report.  However,  as  of  this  writing,  none  of  the 
fielded  systems  has  full  autonomy  in  a  wide  context.  Many  are  capable  of  autonomous  navigation, 
localization,  station  keeping,  reconnaissance  and  other  activities,  but  rely  on  human  supervision  to 
fire  weapons,  launch  missiles,  or  exert  deadly  force  by  other  means;  and  even  the  Navy's  CIWS 
operates  in  full-auto  mode  only  as  a  reactive  last  line  of  defense  against  incoming  missiles  and  does 
not  proactively  engage  an  enemy  or  target.  Clearly,  there  are  fundamental  ethical  implications  in 
allowing  full  autonomy  for  these  robots.  Among  the  questions  to  be  asked  are: 

•  Will  autonomous  robots  be  able  to  follow  established  guidelines  of  the  Laws  of  War  and 
Rules  of  Engagement,  as  specified  In  the  Geneva  Conventions? 

•  Will  robots  know  the  difference  between  military  and  civilian  personnel? 

•  Will  they  recognize  a  wounded  soldier  and  refrain  from  shooting? 

Technical  answers  to  such  questions  are  being  addressed  in  a  study  for  the  US  Army  by  professor 
Ronald  Arkin  from  Georgia  Institute  of  Technology— his  preliminary  report  is  entitled  Governing 
Lethal  Behavior:  Embedding  Ethics  in  a  Hybrid  Deliberative/Reactive  Robot  Architecture  (Arkin 
2007]— and  other  experts  [e.g.,  Sharkey,  2008a].  In  the  following  sections  of  our  report,  we  seek  to 
complement  that  work  by  exploring  other  (mostly  non-technical)  dimensions  of  such  questions, 
specifically  as  they  related  to  ethics  and  risk. 


2.8  Future  Scenarios 


From  the  brief  descriptions  of  the  state  of  the  art  of  robotics  above,  it  is  clear  that  the  field  is  highly 
dynamic.  Robotics  is  inherently  interdisciplinary,  drawing  from  advances  in  computer  science, 
aerospace,  electrical  and  mechanical  engineering,  as  well  as  biology  (to  obtain  models  of  sensing, 
processing  and  physical  action  in  the  animal  kingdom),  sociology,  ergonomics  (to  provide  a  basis  for 
the  design  and  deployment  of  robot  colonies),  and  psychology  (to  obtain  a  basis  for  human-robot 
interaction).  Hence,  discoveries  in  any  of  these  fields  will  have  an  effect  on  the  design  of  future 
robcts  and  may  raise  new  questions  of  risk  and  ethics.  It  would  be  useful,  then,  to  anticipate 
possible  future  scenarios  involving  military  robotics  in  order  to  more  completely  consider  issues  in 
risk  and  ethics,  as  follow: 


2.8.1  Sentry/Immobile  Robots 

A  future  scenario  may  include  robot  sentries  that  guard  not  only  military  installations  but  also 
factories,  government  buildings,  and  the  like.  As  these  guards  acquire  increasing  autonomy,  they 
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may  not  only  challenge  visitors  (''Who  goes  there?")  and  ask  them  to  provide  identification  but  will 
be  equipped  with  a  variety  of  sensors  for  this  purpose:  vision  systems,  bar  code  readers, 
microphones,  sound  analyzers,  and  so  on.  Vision  systems  (and,  if  needed,  fingerprint  readers)  along 
with  large  graphic  memories  may  be  used  to  perform  the  identification.  More  importantly,  the 
guards  will  be  equipped  with  weapons  enabling  them  to  arrest  and,  if  necessary,  to  disable  or  kill  a 
potential  intruder  who  refuses  to  stop  and  be  identified.  Under  what  conditions  will  such  lethal 
force  be  authorized?  What  if  the  robot  confuses  the  identities  of  two  people?  These  are  only  two  of 
the  many  difficult  ethical  questions  which  will  arise  even  in  such  a  basically  'simple'  task  as  guarding 
a  gate  and  challenging  visitors. 

2.8.2  Ground  Vehicles 

We  expect  that  future  generations  of  Army  ground  vehicles,  beyond  the  existing  PackBots  or 
SWORDS  discussed  in  section  2.1  above,  will  feature  significantly  more  and  better  sensors,  better 
ordnance,  more  sophisticated  computers,  and  associated  software.  Advanced  software  will  be 
needed  to  accomplish  several  tasks,  such  as: 

(a)  Sensor  fusion:  More  accurate  situational  awareness  will  require  the  technical  ability  to  assign 
degrees  of  credibility  to  each  sensor  and  then  combine  information  obtained  from  them.  For 
example,  in  the  vicinity  of  a  'safe  house',  the  robot  will  have  to  combine  acoustic  data  (obtained 
from  a  variety  of  microphones  and  other  sensors)  with  visual  information,  sensing  of  ground 
movement,  temperature  measurements  to  estimate  the  number  of  humans  within  the  house,  and  so 
on.  These  estimates  will  then  have  to  be  combined  with  reconnaissance  data  (say  from  autonomous 
flying  vehicles)  to  obtain  a  probabilistic  estimate  of  the  number  of  combatants  within  the  house. 

(b)  Attack  decisions:  Sensor  data  will  have  to  be  processed  by  software  that  considers  the  applicable 
Rules  of  Engagement  and  Laws  of  War  in  order  for  a  robot  to  make  decisions  related  to  lethal  force. 
It  is  important  to  note  that  the  decision  to  use  lethal  force  will  be  based  on  probabilistic  calculations, 
and  absolute  certainty  will  not  be  possible.  If  multiple  robot  vehicles  are  involved,  the  system  will 
also  be  required  to  allocate  functions  to  individual  members  of  the  group,  or  they  will  be  required  to 
negotiate  with  each  other  to  determine  their  Individual  functions.  Such  negotiation  Is  a  current  topic 
of  much  challenging  research  in  robotics. 

(c)  Human  supervision:  We  anticipate  that  autonomy  will  be  granted  to  robot  vehicles  gradually,  as 
confidence  in  their  ability  to  perform  their  assigned  tasks  grows.  Further,  we  expect  to  see  learning 
algorithms  that  enable  the  robot  to  improve  its  performance  during  training  missions.  Even  so,  there 
will  be  fundamental  ethical  Issues.  For  example,  will  a  supervising  warfighter  be  able  to  override  a 
robot's  decision  to  fire?  If  so,  how  much  time  will  have  to  be  allocated  to  allow  such  decisions?  Will 
the  robot  have  the  ability  to  disobey  a  human  supervisor's  command,  say  in  a  situation  where  the 
robot  makes  the  decision  not  to  release  a  missile  on  the  basis  that  its  analysis  leads  to  the  conclusion 
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that  the  number  of  civilians  (say  women  and  children)  greatly  exceeds  the  number  of  insurgents  in 
the  house? 

2.8.3  Aerial  Vehicles 

Clearly,  many  of  the  same  consideration  that  apply  to  ground  vehicles  will  also  apply  to  UFVs,  with 
the  additional  complexity  that  arises  from  moving  in  three  degrees  of  freedom,  rather  than  two  as 
on  the  surface  of  the  earth.  Hence,  the  UFV  must  sense  the  environment  in  the  x,  y,  and  z  directions. 
The  UFV  may  be  required  to  bomb  particular  installations,  in  which  case  it  will  be  governed  by  similar 
considerations  to  those  described  above.  However,  there  may  be  others:  for  instance,  an  aircraft  is 
generally  a  much  more  expensive  system  than  a  small  ground  vehicle  such  as  the  SWORDS.  What 
evasive  action  should  the  vehicle  undertake  to  protect  itself?  It  should  have  the  ability  to  return  to 
base  and  land  autonomously,  but  what  should  it  do  if  challenged  by  friendly  aircraft?  Are  there 
situations  in  which  it  may  be  justified  in  destroying  friendly  aircraft  (and  possibly  killing  human  pilots) 
to  ensure  its  own  safe  return  to  base?  The  UFV  will  be  required  to  communicate  with  UGVs  and  to 
coordinate  strategy  when  necessary.  How  should  decisions  be  made  if  there  is  disagreement 
between  airborne  and  ground  vehicles?  If  there  are  hybrid  missions  that  include  both  piloted  and 
autonomous  aircraft,  who  is  in  charge? 

These  are  not  a  trivial  question,  since  contemporary  aircraft  move  at  very  high  speeds,  making  the 
length  of  time  required  for  decisions  inadequate  for  human  cognitive  processes.  In  addition,  vehicles 
may  be  of  vastly  different  size,  speed  and  capability.  Further,  under  what  conditions  should  a  UFV  be 
permitted  to  cross  national  boundaries  in  the  pursuit  of  an  enemy  aircraft?  Since  national 
boundaries  are  not  painted  on  the  ground,  the  robot  aircraft  will  have  to  rely  on  stored  maps  and 
GPS  measurements,  which  may  be  faulty. 

2.8.4  Marine  Vehicles 

Many  of  the  same  challenges  that  apply  to  airborne  vehicles  also  apply  to  those  traveling  under 
water.  Again,  they  must  operate  in  multiple  degrees  of  freedom.  In  addition,  the  sensory  abilities  of 
robot  submarines  will  be  quite  different  from  those  of  ground  or  air  vehicles,  given  the  properties  of 
water.  Thus,  sonar  echoes  can  be  used  to  identify  the  presence  of  underwater  objects,  but  these 
signals  require  interpretation.  Assume  that  the  robot  submarine  detects  the  presence  of  a  surface 
vessel,  which  is  presumed  to  carrying  enemy  weapons,  as  well  as  civilian  passengers:  under  what 
conditions  should  the  robot  submarine  launch  torpedoes  to  destroy  the  surface  vessel?  It  may  be 
much  more  difficult  to  estimate  the  number  of  civilians  aboard  an  iron  ship  than  those  present  in  a 
wooden  house.  How  can  the  robot  make  intelligent  decisions  in  the  absence  of  critical  information? 

It  is  evident  that  the  use  of  autonomous  robots  in  warfare  will  pose  a  large  number  of  ethical 
challenges.  In  the  next  sections,  we  discuss  some  programming  approaches  and  their  relationship  to 
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ethical  theories,  issues  related  to  responsibility  and  law  (including  LOW/ROE),  and  expand  on  the 
various  ethical  and  risk  issues  we  have  raised  in  the  course  of  this  report. 


303 


NOOO 1 4-07- M  152 


P.l. Susan  C.  Opava,  Ph.D. 


3.  Programming  Morality 


What  role  might  ethical  theory  play  in  defining  the  control  architecture  for  semi-autonomous  and 
autonomous  robots  used  by  the  military?  What  moral  standards  or  ethical  subroutines  should  be 
implemented  in  a  robot?  This  section  explores  the  ways  in  which  ethical  theory  may  be  helpful  for 
implementing  moral  decision  making  faculties  in  robots/ 

Engineers  are  very  good  at  building  systems  to  satisfy  clear  task  specifications,  but  there  is  no  clear 
task  specification  for  general  moral  behavior,  nor  is  there  a  single  answer  to  the  question  of  whose 
morality  or  what  morality  should  be  implemented  in  Al.  However,  military  operations  are  conducted 
within  a  legal  framework  of  international  treaties  as  well  as  the  nation's  own  military  code.  This 
suggests  that  the  rules  governing  acceptable  conduct  of  personnel  might  perhaps  be  adapted  for 
robots;  one  might  attempt  to  design  a  robot  which  has  an  explicit  internal  representation  of  the  rules 
and  strictly  follows  them. 

A  robotic  code  would,  however,  probably  need  to  differ  in  some  respects  from  that  for  a  human 
soldier.  For  example,  self-preservation  may  be  less  of  a  concern  for  the  robotic  system,  both  in  the 
way  it  Is  valued  by  the  military  and  In  its  programming.  Furthermore,  what  counts  as  a  strictly 
correct  Interpretation  of  the  laws  in  a  specific  situation  is  itself  likely  to  be  a  matter  for  dispute,  and 
conflicts  among  duties  or  obligations  will  require  assessment  in  light  of  more  general  moral 
principles.  Regardless  of  what  code  of  ethics,  norms,  values,  laws,  or  principles  are  adopted  for  the 
design  of  an  artificial  moral  agent  (AMA),  whether  the  system  functions  successfully  will  need  to  be 
evaluated  through  externally-determined  criteria  and  testing. 


3.1  From  Operational  to  Functional  Morality 


Safety  and  reliability  have  always  been  a  concern  for  engineers  in  their  design  of  intelligent  systems 
and  for  the  military  in  its  choice  of  equipment.  Remotely-operated  vehicles  and  semi-autonomous 
weapons  systems  used  during  military  operations  need  to  be  reliable,  and  they  should  be  destructive 
only  when  directed  at  designated  targets.  Not  all  robots  utilized  by  the  military  will  be  deployed  in 
combat  situations,  however,  establishing  as  a  priority  that  all  intelligent  systems  are  safe  and  do  no 
harm  to  (friendly)  military  personnel,  civilians,  and  other  agents  worthy  of  moral  consideration. 


^  We  thank  and  credit  Wendell  Wallach  and  Colin  Allen  for  their  contribution  to  many  of  the  discussions  here,  drawn 
from  *:heir  new  book  Moral  Machines:  Teaching  Robots  Right  from  Wrong  (Oxford  University  Press,  2008). 
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When  robots  with  even  limited  autonomy  must  choose  from  among  different  courses  of  action,  the 
concern  for  safety  is  transmuted  into  the  need  for  the  systems  to  have  a  capacity  for  making  moral 
judgments.  For  robots  that  operate  within  a  very  limited  context,  the  designers  and  engineers  who 
build  the  systems  may  well  be  able  to  discern  all  the  different  options  the  robot  will  encounter  and 
program  the  appropriate  responses.  The  actions  of  such  a  robot  are  completely  In  the  hands  of  the 
designers  of  the  systems  and  those  who  choose  to  deploy  them;  these  robots  are  operationally 
moral.  They  do  not  have,  and  presumably  will  not  need,  a  capacity  to  explicitly  evaluate  the 
consequences  of  their  actions.  They  will  not  need  to  evaluate  which  rules  apply  in  a  particular 
situation,  nor  need  to  prioritize  conflicting  rules. 

However,  three  factors  suggest  that  operational  morality  is  not  sufficient  for  many  robotic 
applications:  (1)  the  increasing  autonomy  of  robotic  systems;  (2)  the  prospect  that  systems  will 
encounter  influences  that  their  designers  could  not  anticipate  because  of  the  complexity  of  the 
environments  in  which  they  are  deployed,  or  because  the  systems  are  used  in  contexts  for  which 
they  were  not  specifically  designed;  and  (3)  the  complexity  of  technology  and  the  Inability  of  systems 
engineers  to  predict  how  the  robots  will  behave  under  a  new  set  of  Inputs. 

The  choices  available  to  systems  that  possess  a  degree  of  autonomy  in  their  activity  and  in  the 
contexts  within  which  they  operate,  and  greater  sensitivity  to  the  moral  factors  impinging  upon  the 
course  of  actions  available  to  them,  will  eventually  outstrip  the  capacities  of  any  simple  control 
architecture.  Sophisticated  robots  will  require  a  kind  of  functional  morality,  such  that  the  machines 
themselves  have  the  capacity  for  assessing  and  responding  to  moral  considerations.  However,  the 
engineers  that  design  functionally  moral  robots  confront  many  constraints  due  to  the  limits  of 
present-day  technology.  Furthermore,  any  approach  to  building  machines  capable  of  making  moral 
decisions  will  have  to  be  assessed  in  light  of  the  feasibility  of  implementing  the  theory  as  a  computer 
program. 

In  the  following,  we  will  briefly  examine  several  major  theories— deontological  (rule-based)  ethics, 
consequentialism,  natural  law,  social  contract  ethics,  and  virtue  ethics— as  possible  ethical 
frameworks  in  robots.  (A  complete  discussion  of  these  theories  and  their  relative  plausibility  is 
beyond  the  scope  of  this  report  and  can  be  readily  found  in  philosophical  literature  [e.g.  University  of 
San  Diego,  2008].) 

First,  let  us  dismiss  one  important  possibility:  ethical  relativism,  or  the  position  that  there  Is  no  such 
thing  as  objectivity  in  ethical  matters,  i.e.,  what  is  right  or  wrong  is  not  a  matter  of  fact  but  a  result  of 
Individual  or  cultural  preferences.  Even  if  it  were  true  that  ethics  is  relative  to  cultural  preferences, 
this  would  have  no  bearing  on  a  project  to  develop  autonomous  military  robots,  since  the  US  military 
and  Its  code  of  ethics  would  be  the  standard  for  our  robots  anyway,  as  opposed  to  programming 
some  other  nation's  morality  into  our  machines.  Further,  we  can  expect  that  such  robots  will  be 
employed  only  in  specific  environments,  at  least  for  the  foreseeable  future,  which  suggests  a  more 
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limited,  practical  programming  approach;  so  a  broad  or  all-encompassing  theory  of  ethics  is  not 
immediately  urgent,  and  thus  we  need  not  settle  the  question  of  whether  ethics  is  objective  here. 

That  is,  the  idea  of  an  autonomous  general-  or  even  multi-purpose  robot  (which  might  require  a 
broad  framework  to  govern  a  full  range  of  possible  actions)  is  much  more  distant  than  the  possibility 
of  an  autonomous  robot  created  for  specific  military-related  tasks,  such  as  patrolling  borders  or 
urban  areas,  or  exercising  lethal  force  In  a  carefully  circumscribed  battlefield.  Given  the  limited 
operations  of  such  robots,  the  initial  ethical  task  will  be  sufficient  to  simply  program  in  the  suitable 
basic,  relevant  rules.  In  the  next  section,  we  will  delineate  the  Laws  of  War  and  Rules  of  Engagement 
that  would  govern  the  robot's  behavior;  these  laws  already  are  established  and  codified,  making 
programming  easier  (in  theory).  We  will  also  offer  challenges  and  further  difficulties  related  to  the 
approach  of  using  the  LOW  and  ROE  as  an  ethical  framework,  and  discuss  longer-term  issues  that 
may  arise  as  robots  have  greater  autonomy  and  responsibility. 


3.2  Overview:  Top-Down  and  Bottom-Up  Approaches 


The  challenge  of  building  artificial  moral  agents  (AMAs)  might  be  understood  as  finding  ways  to 
implement  abstract  values  within  the  control  architecture  of  intelligent  systems.  Philosophers 
confronted  with  this  problem  are  likely  to  suggest  a  top-down  approach  of  encoding  a  particular 
ethical  theory  in  software.  This  theoretical  knowledge  could  then  be  used  to  rank  options  for  moral 
acceptability.  Psychologists  confronted  with  the  problem  of  constraining  moral  decision-making  are 
likely  to  focus  on  the  way  a  sense  of  morality  develops  in  human  children  as  they  mature  into  adults. 
Their  approach  to  the  development  of  moral  acumen  is  bottom-up  In  the  sense  that  it  is  acquired 
over  time  through  experience.  The  challenge  for  roboticists  is  to  decide  whether  a  top-down  ethical 
theory  or  a  bottom-up  process  of  learning  is  the  more  effective  approach  for  building  artificial  moral 
agents. 

The  study  of  ethics  commonly  focuses  on  top-down  norms,  standards,  and  theoretical  approaches  to 
moral  judgment.  From  Socrates'  dismantling  of  theories  of  justice  to  Kant's  project  of  rooting 
morality  within  reason  alone,  ethical  discourse  has  typically  looked  at  the  application  of  broad 
standards  of  morality  to  specific  cases.  According  to  these  approaches,  standards,  norms,  or 
principles  are  the  basis  for  evaluating  the  morality  of  an  action. 

The  term  'top-down'  is  used  in  a  different  sense  by  engineers,  who  approach  challenges  with  a  top- 
down  analysis  through  which  they  decompose  a  task  into  simpler  subtasks.  Components  are 
assembled  into  modules  that  individually  implement  these  simpler  subtasks,  and  then  the  modules 
are  hierarchically  arranged  to  fulfill  the  goals  specified  by  the  original  project. 

In  our  discussion  of  machine  morality,  we  use  'top-down'  in  a  way  that  combines  these  two 
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somewhat  different  senses  from  engineering  and  ethics.  In  our  broader  sense,  a  top-down  approach 
to  the  design  of  AMAs  is  any  approach  that  takes  a  specified  ethical  theory  and  analyzes  its 
computational  requirements  to  guide  the  design  of  algorithms  and  subsystems  capable  of 
implementing  that  theory. 

In  the  bottom-up  approaches  to  machine  morality,  the  emphasis  is  placed  on  creating  an 
environment  where  an  agent  explores  courses  of  action  and  is  rewarded  for  behavior  that  is  morally 
praiseworthy.  In  this  manner,  the  artificial  agent  develops  or  learns  through  its  experience.  Unlike 
top-down  ethical  theories,  which  define  what  is  and  is  not  moral,  ethical  principles  must  be 
discovered  or  constructed  in  bottom-up  approaches.  Bottom-up  approaches.  If  they  use  a  prior 
theory  at  all,  do  so  only  as  a  way  of  specifying  the  task  for  the  system,  and  not  as  a  way  of  specifying 
an  implementation  method  or  control  structure. 

Engineers  would  find  this  top-down/bottom-up  dichotomy  to  be  rather  simplistic  given  the 
complexity  of  many  engineering  tasks.  However,  the  concepts  of  top-down  and  bottom-up  task 
analysis  are  helpful  In  that  they  highlight  two  different  roles  for  ethical  theory  in  facilitating  the 
design  of  AMAs. 


3.3  Top-Down  Approaches 


Are  ethical  principles,  theories,  and  frameworks  useful  in  guiding  the  design  of  computational 
systems  capable  of  acting  with  some  degree  of  autonomy?  Can  top-down  theories— such  as 
utilitarianism,  or  Kanfs  categorical  imperative,  or  even  Asimov's  laws  for  robots— be  adapted 
practically  by  roboticists  for  building  AMAs? 

Top-down  approaches  to  artificial  morality  are  generally  understood  as  having  a  set  of  rules  that  can 
be  turned  into  an  algorithm.  These  rules  specify  the  duties  of  a  moral  agent  or  the  need  for  the 
agent  to  calculate  the  consequences  of  the  various  courses  of  action  it  might  select.  The  history  of 
moral  philosophy  can  be  viewed  as  a  long  Inquiry  into  the  adequacy  of  any  one  ethical  theory;  thus, 
selecting  any  particular  theoretical  framework  may  not  be  adequate  for  ensuring  an  artificial  agent 
will  behave  acceptably  in  all  situations.  However,  one  theory  or  another  Is  often  prominent  in  a 
particular  domain,  and  for  the  foreseeable  future  most  robots  will  function  within  limited  domains  of 
activity. 


3.3.1  Top-Down  Rules:  Deontology 

A  basic  grounding  in  ethical  theory  naturally  begins  with  the  idea  that  morality  simply  consists  in 
following  some  finite  set  of  rules:  deontological  ethics,  or  that  morality  is  about  simply  doing  one's 
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duty.  Deontological  (duty-based)  ethics  presents  ethics  as  a  system  of  inflexible  rules;  obeying  them 
makes  one  moral,  breaking  them  makes  one  immoral.  Ethical  constraints  are  seen  as  a  list  of  either 
forbidden  or  permissible  forms  of  behavior.  Kant's  Categorical  Imperative  (Cl)  is  typical  of  a 
deontological  approach,  as  follows  in  its  two  main  components: 

Cl(ll  -  This  is  often  called  the  formula  of  universal  law  (FUL),  which  commands:  "Act  only  in 
accordance  with  that  maxim  through  which  you  can  at  the  same  time  will  that  it  become  a  universal 
law"  [Kant,  1785,  4:421].  Alternatively,  the  Cl  also  has  been  understood  as  that  the  relevant 
legislature  should  pass  such  a  law  mandating  my  action,  i.e.,  a  'Universal  Law  of  Nature.' 

A  maxim  is  a  statement  of  one's  intent  or  rationale:  it  is  the  answer  to  the  query  about  why  one  did 
what  was  done.  So  Kant  asserts  that  the  only  intentions  that  are  moral  are  those  that  could  be 
universally  held;  partiality  has  no  place  in  moral  thought.  Kant  also  asserts  that  when  we  treat  other 
people  as  a  mere  means  to  our  ends,  such  action  must  be  immoral;  after  all,  we  ourselves  don't  wish 
to  be  treated  that  way.  Hence,  when  applying  the  Cl  in  any  social  interaction,  Kant  provides  a  second 
formulation  as  a  purported  corollary: 

Cl(2;  -  Variously  called  the  Humanity  formulation  of  the  Cl,  or  the  Means-Ends  Principle,  or  the 
formula  of  the  end  in  itself  (FEI),  It  commands:  "So  act  that  you  use  humanity,  whether  in  your  own 
person  or  In  the  person  of  any  other,  always  at  the  same  time  as  an  end,  never  merely  as  a  means" 
[Kant,  1785,  4:429].  One  could  never  universalize  the  treatment  of  another  as  a  mere  means  to 
some  other  ends,  claims  Kant,  in  his  explanation  that  Cl(2)  directly  follows  from  Cl(l).  This 
formulation  is  credited  with  introducing  the  idea  of  'respect'  for  persons;  that  is,  respect  for 
whatever  it  Is  that  is  essential  to  our  Humanity,  for  whatever  collective  attributes  are  required  for 
human  dignity  [Johnson,  2008]. 

A  Kantian  deontologist  thus  believes  that  acts  such  as  stealing  and  lying  are  always  immoral,  because 
universalizing  them  creates  a  paradox.  For  instance,  one  cannot  universalize  lying  without  running 
into  the  'Liar's  paradox'  (that  it  cannot  be  true  that  all  statements  are  a  lie);  similarly,  one  cannot 
universalize  stealing  property  without  undermining  the  very  concept  of  property.  Kant's  approach  is 
widely  influential  but  has  problems  of  applicability  and  disregard  for  consequences. 

3.3.2  Asimov's  Laws  of  Robotics 

Another  deontological  approach  often  comes  to  mind  In  investigating  robot  ethics:  Asimov's  Three 
Laws  of  Robotics  (he  later  added  a  fourth  or  'Zeroth  Law')  are  intuitively  appealing  in  their  simple 
demand  to  not  harm  or  allow  humans  to  be  harmed,  to  obey  humans,  and  to  engage  in  self- 
preservation.  Furthermore,  the  laws  are  prioritized  to  minimize  conflicts.  Thus,  doing  no  harm  to 
humans  takes  precedence  over  obeying  a  human,  and  obeying  trumps  self-preservation.  However, 
in  story  after  story,  Asimov  demonstrated  that  three  simple  hierarchically-arranged  rules  could  lead 
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to  deadlocks  when,  for  example,  the  robot  received  conflicting  instructions  from  two  people  or  when 
protecting  one  person  might  cause  harm  to  others. 

The  original  version  of  Asimov's  Three  Laws  of  Robotics  are  as  follows:  (1)  a  robot  may  not  Injure  a 
human  being  or,  through  inaction,  allow  a  human  being  to  come  to  harm;  (2)  a  robot  must  obey 
orders  given  to  it  by  human  beings,  except  where  such  orders  would  conflict  with  the  First  Law;  (3);  a 
robot  must  protect  its  own  existence  as  long  as  such  protection  does  not  conflict  with  the  First  or 
Second  Law  [Asimov,  1950]. 

Asimov's  fiction  explored  the  implications  and  difficulties  of  the  Three  Laws  of  Robotics.  It 
established  that  the  first  law  was  incomplete  as  stated,  due  to  the  problem  of  ignorance:  a  robot  was 
fully  capable  of  harming  a  human  being  as  long  as  it  did  not  know  that  its  actions  would  result  in  (a 
risk  of)  harm,  i.e.,  the  harm  was  unintended.  For  example,  a  robot,  in  response  to  a  request  for 
water,  could  serve  a  human  a  glass  of  water  teeming  with  bacterial  contagion,  or  throw  a  human 
down  a  well,  or  drown  a  human  in  a  lake,  ad  infinitum,  as  long  as  the  robot  was  unaware  of  the  risk 
of  harm.  One  solution  is  to  rewrite  the  first  and  subsequent  laws  with  an  explicit  knowledge- 
qualifier:  "A  robot  may  do  nothing  that,  to  its  knowledge,  will  harm  a  human  being;  nor,  through 
inaction,  knowingly  allow  a  human  being  to  come  to  harm"  [Asimov,  1957].  But  a  clever  criminal 
could  divide  a  task  among  multiple  robots,  so  that  no  one  robot  could  even  recognize  that  its  actions 
would  lead  to  harming  a  human,  e.g.,  one  robot  places  the  dynamite,  another  attaches  a  length  of 
cord  to  the  dynamite,  a  third  lights  the  cord,  and  so  on.  Of  course,  this  simply  illustrates  the  problem 
with  deontological,  top-down  approaches,  that  one  may  follow  the  rules  perfectly  but  still  produce 
terrible  consequences. 

An  additional  difficulty  is  that  the  degree  of  risk  makes  a  difference  too,  e.g.,  should  robots  keep 
humans  from  working  near  X-ray  machines  because  of  a  small  risk  of  cancer,  and  how  would  a  robot 
decide?  (Section  6  on  risk  assessment  will  explore  this  topic  further).  The  'through  inaction'  clause 
of  Asimov's  first  law  raises  another  Issue:  Wouldn't  a  robot  have  to  constantly  intervene  to  minimize 
all  sorts  of  risks  to  humans,  and  never  be  able  to  perform  its  primary  tasks?  Asimov  considers  a 
modified  First  Law  to  solve  this  issue:  (!')  A  robot  may  not  harm  a  human  being.  Removing  the  First 
Law's  'inaction'  clause  solves  this  problem,  but  t  does  so  at  the  expense  of  creating  an  even  greater 
one:  a  robot  could  initiate  an  action  which  would  harm  a  human  (for  example,  initiating  an  automatic 
firing  sequence,  then  watching  a  noncombatant  wander  into  the  firing  line)  knowing  that  it  was 
capable  of  preventing  the  harm  (by  ceasing  the  automatic  firing),  but  it  may  nevertheless  fail  to  do 
so  since  it  is  now  not  strictly  required  to  act. 

Asimov  later  added  a  Zeroth  Law  [Asimov,  1985]— so  named  to  continue  the  pattern  of  lower- 
numbered  laws  superseding  in  importance  the  higher-numbered  laws— so  that  the  Zeroth  Law  had 
highest  priority  and  must  not  be  broken:  (0)  a  robot  may  not  harm  all  humanity  or,  through  inaction, 
allow  humanity  to  come  to  harm.  This  would  allow  a  robot  to  harm  individual  humans,  if  so  doing 
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prevented  an  'existential  threat'  to  all  humanity.  But  how  could  a  robot  determine  when  such  a 
threat  exists,  and  hence  killing  individual  humans  to  prevent  it  is  permitted? 

3.3.3  Fixing  Asimov's  laws 

Other  authors  have  attempted  to  fix  other  ambiguities  and  loopholes  in  the  rules  Asimov  devised,  in 
order  to  prevent  disastrous  scenarios  that  nonetheless  satisfied  laws  numbered  0-3.  For  example, 
Lyuben  Dilov  [1974]  introduced  a  Fourth  Law  of  Robotics  to  avoid  misunderstandings  about  what 
counts  as  a  human  and  as  a  robot:  (4)  a  robot  must  establish  its  identity  as  a  robot  in  all  cases.  This 
law  is  sometimes  stated  as  the  slightly  different:  (4  ).  A  robot  must  know  It  Is  a  robot.  Others  [e.g. 
Harrison,  1989]  have  also  argued  for  a  Fourth  Law  that  requires  robots  to  reproduce,  as  long  as  such 
reproduction  does  not  interfere  with  laws  1-3. 

Asimov's  literary  exercise  was  illustrative  of  a  limitation  inherent  in  any  rule-based  morality:  What 
does  the  robot  do  when  there  are  conflicts  between  the  rules?  Should  rules  function  as  hard 
restraints?  Or  can  the  rules  function  as  guidelines  where  the  system  is  designed  to  factor  in  an  array 
of  prima  facie  duties  in  the  actions  it  considers?  Will  this  open  the  door  to  robotic  behavior  that 
should  be  prohibited?  Perhaps  the  biggest  challenges  confronting  designers  of  rule-based  robots  or 
AMAs  is  how  the  system  will  recognize  those  situations  that  require  application  of  the  rules,  and  how 
to  ensure  that  the  robot  has  access  to  all  the  Information  it  needs  In  order  to  apply  rules 
appropriately.  How  would  a  robot  programmed  with  the  First  Law  know,  for  example,  that  a  medic 
or  surgeon  welding  a  knife  over  a  fallen  fighter  on  the  battlefield  Is  not  about  to  harm  the  soldier? 
The  robot  would  need  to  understand  a  great  deal  about  context,  exceptions  to  rules,  and  human 
psychology;  and  its  knowledge  base  would  need  to  be  updated  regularly. 

Roger  Clarke  [1994]  attempted  to  update  and  fix  Asimov's  laws,  in  what  he  called  "An  Extended  Set 
of  the  Laws  of  Robotics": 

"The  Meta-Law:  A  robot  may  not  act  unless  its  actions  are  subject  to  the  Laws  of  Robotics. 
Law  Zero:  A  robot  may  not  injure  humanity,  or,  through  inaction,  allow  humanity  to  come  to 
harm. 

Law  One:  A  robot  may  not  Injure  a  human  being,  or,  through  Inaction,  allow  a  human  being 
to  come  to  harm,  unless  this  would  violate  a  higher-order  Law. 

Law  Two:  A  robot  must  obey  orders  given  It  by  human  beings,  except  where  such  orders 
would  conflict  with  a  higher-order  Law;  a  robot  must  obey  orders  given  it  by 
superordinate  robots,  except  where  such  orders  would  conflict  with  a  higher-order  Law. 
Law  Three:  A  robot  must  protect  the  existence  of  a  superordinate  robot  as  long  as  such 
protection  does  not  conflict  with  a  higher-order  Law;  a  robot  must  protect  its  own 
existence  as  long  as  such  protection  does  not  conflict  with  a  higher-order  Law. 


310 


NOOO 14-07-1-1 152 


P.LSusan  C.  Opava,  Ph.D. 


Law  Four:  A  robot  must  perform  the  duties  for  which  it  has  been  programmed,  except  where 
that  would  conflict  with  a  higher-order  law. 

The  Procreation  Law:  A  robot  may  not  take  any  part  in  the  design  or  manufacture  of  a  robot 
unless  the  new  robot's  actions  are  subject  to  the  Laws  of  Robotics," 

Clarke  admits  that  his  revised  laws  still  face  serious  problems,  including  the  identification  of  and 
consultation  with  stakeholders  and  how  they  are  affected,  as  well  as  issues  of  quality  assurance, 
liability  for  harm  resulting  from  either  malfunction  or  proper  use,  and  complaint-handling,  dispute- 
resolution,  and  enforcement  procedures.  Our  discussion  of  product  liability  in  section  5  will  address 
many  of  these  concerns. 

There  are  additional  problems  that  occur  when  moral  laws  for  robots  are  given  in  the  military 
context.  To  begin  with,  military  officers  are  aware  that  if  codes  of  conduct  or  Rules  of  Engagement 
are  not  comprehensive,  then  proper  behavior  cannot  be  assured.  One  difficulty  lies  in  the  fact  that 
as  the  context  gets  more  complex,  it  becomes  impossible  to  anticipate  all  the  situations  that  soldiers 
will  encounter,  thus  leaving  the  choice  of  behavior  in  many  situations  up  to  the  best  judgment  of  the 
soldier.  The  desirability  of  placing  machines  in  this  situation  is  a  policy  decision  that  is  likely  to 
evolve  as  the  technological  sophistication  of  AMAs  improves. 

Unfortunately,  there  are  yet  further  problems:  most  pertinently,  even  if  their  glitches  could  be 
ironed  out,  Asimov's  laws  will  remain  simply  inapplicable  to  the  military  context,  as  it  is  likely  that 
autonomous  military  robots  will  be  asked  to  exercise  lethal  force  upon  humans  in  order  to  attain 
mission  objectives,  thereby  violating  Asimov's  First  Law,  A  further  problem,  called  'rampancy', 
involves  the  possibility  that  an  autonomous  robot  could  overwrite  its  own  basic  programming  and 
substitute  its  own  new  goals  for  the  original  mission  objectives  (e,g,,  the  movie  Stealth).  That  leads 
us  to  a  final  and  apparently  conclusive  reason  why  deontological  ethics  cannot  be  used  for 
autonomous  military  robots:  it  is  incompatible  with  a  'slave  morality',  as  addressed  in  the  following 
discussion  (and  further  in  section  6). 


3.3.4  Slavery:  A  Crucial  Problem  for  Deontology  and  Robotic  ethics 

One  further  problem,  specific  to  robotics,  with  deontological  ethics  is  the  problem  of  'slave  morality,' 
Robots  in  the  military  would  be  presumably  programmed  to  follow  commands  slavishly,  and  not 
exhibit  anything  like  true  Kantian  autonomy.  Indeed,  the  term  'robot'  is  derived  from  the  Czech 
word  'robota'  that  means  'servitude'  or  'drudgery'  or  'labor'  (see  'Appendix  A:  Definitions'),  Such 
robots  could  make  autonomous  choices  about  the  means  to  carrying  out  their  pre-programmed 
goals,  but  not  about  the  goals  themselves;  they  could  not  choose  their  own  goals  for  themselves,  but 
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they  would  always  be  expected  to  have  the  goal  of  obeying  orders  given  by  their  military 
commander. 

That  would  collapse  (from  a  deontological  perspective)  all  questions  about  their  ethics  into  simply 
questions  about  the  ethics  of  the  military  commander,  and  mutatis  mutandis  for  any  other  use  of 
autonomous  robots  as  slaves.  Such  an  approach  would  then  claim  that  there  is  actually  no  such 
thing  as  robot  ethics;  there  are  only  the  ethics  of  those  who  command  robots.  But  the  concerns  with 
robot  ethics  crucially  concern  the  consequences  of  using  them— a  concern  a  strict  deontological 
ethics  cannot  countenance  as  it  insists  that  one  must  obey  the  rules,  no  matter  the  consequences. 
And  of  course,  a  key  objection  (that  will  affect  both  deontological  and  utilitarian  ethics)  is  the 
plausible  skeptical  claim  that  no  finite  set  of  rules  can  ever  guarantee  ethical  behavior  in  all  cases,  or 
at  least  where  the  set  of  possible  behaviors  is  large  or  practically  unlimited.  Before  addressing  that 
critique,  let  us  examine  perhaps  the  most  important  objection  to  deontology  (and  the  resulting 
alternative  approach)— that  consequences  matter  morally,  and  simply  following  the  rules  is  morally 
wrong  if  it  leads  to  bad  outcomes. 

3.3.5  Top’Down  Approaches:  Utilitarian  Consequentialism 

Utilitarianism  represents  another  attempt  to  bypass  conflicts  between  rules  through  an  overriding 
top-down  principle  that  can  be  applied  to  all  situations.  However,  with  respect  to  computability,  this 
approach  stresses  the  importance  of  the  outcomes  (consequentialism)  arising  from  an  action. 
Consequentialist  approaches  to  ethics  focus  on  achieving  the  best  possible  outcomes  in  various 
situations,  and  hence  typically  disdain  rigid  rules  that  specify  unchanging  duties.  For  example, 
utilitarianism— the  primary  consequentialist  theory—  proposes  that  an  agent  should  calculate  the 
net  consequences  arising  from  the  various  available  courses  of  action,  and  then  select  the  action  that 
offers  'the  greatest  good  for  the  greatest  number.'  This  is  a  familiar,  pragmatic  theory  in  that  many 
policy  and  business  decisions  seem  to  be  determined  by  a  weighing  of  reasons  for  and  against  a 
particular  action,  and  it  suggests  a  simple  algorithm  for  calculating  what  action  one  ought  to  take  in  a 
given  situation. 

However,  this  approach  is  not  as  computationally  tractable  as  it  might  appear.  Practically,  there  is 
the  calculational  objection:  it  is  an  impossible  demand  to  calculate  the  utility  of  every  action;  thus, 
utilitarianism  makes  moral  evaluation  impossible,  as  even  the  short-term  consequences  of  most 
actions  are  impossible  to  accurately  forecast,  much  less  the  long-term  consequences.  Problems  of 
how  utility  might  be  represented  within  a  computational  system,  how  broadly  the  consequences  of 
actions  should  be  analyzed,  and  which  agent's  welfare  should  be  included  in  the  calculation  need  to 
be  resolved  in  order  to  bring  a  utilitarian  analysis  to  a  successful  conclusion.  Given  limitations  of 
available  information,  the  breadth  of  variables  impinging  upon  a  complex  set  of  interrelated  agents, 
and  therefore  an  inability  to  accurately  predict  the  consequences  of  an  action,  such  a  calculation 
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poses  a  tremendous  computation  load  on  even  the  fastest  systems.  A  utilitarian  robot  may  fail  to 
determine  which  course  of  action  is  most  acceptable  within  the  time  allotted. 

But  if  utility  is  incalculable,  and  one's  obligation  is  to  maximize  utility,  much  of  the  theory's  value 
seems  to  disappear.  Worse,  there  are  further  objections  to  utilitarianism:  the  absurd  implications 
objection  would,  for  example,  point  to  some  scenario  in  which  a  lie  is  just  as  moral  as  truth,  if  the 
consequences  are  the  same.  Even  more  fundamental  are  objections  based  on  (in)justice.  For 
example,  the  scapegoating  objection  would  point  out  that  maximizing  utility  may  demand  injustice, 
such  as  executing  an  innocent  person  to  prevent  a  riot  that  would  have  resulted  in  deaths  and 
economic  damage.  This  is  to  say  that  utilitarianism,  at  least  in  its  basic  form,  cannot  readily  account 
for  the  notion  of  rights  and  duties  nor  moral  distinctions  between,  e.g.,  killing  versus  letting  die  or 
intended  versus  merely  foreseen  deaths  (assuming  we  think  such  notions  and  distinctions  exist). 

Whether  deontological  or  consequentialist/utilitarian,  each  of  the  single-principle  top-down  theories 
suffers  from  a  version  of  the  frame  problem— that  is,  it  requires  an  impossible  computational  load 
due  to  the  requirements  for  knowledge  of  the  relevant  effects  of  action  in  the  world,  the  difficulty  of 
estimating  the  sufficiency  of  the  initial  information,  and  knowledge  about  the  psychology  of  agents. 
Nevertheless,  humans  appear  to  apply  rough  and  ready  top-down  evaluations  in  their  selection  of 
courses  of  action,  and  so  might  a  robotic  system,  particularly  if  the  goal  is  not  to  create  a  perfect 
system  but  only  one  that  makes  better  (or  just  as  good)  decisions  than  humans  do. 

Top-down  theories  combine  strength  in  defining  ethical  criteria  with  a  breadth  that  can  be  applied  to 
countless  challenges.  The  price  of  this  strength  lies  In  the  goals  either  being  defined  so  vaguely  and 
abstractly  that  their  meaning  and  their  application  to  specific  situations  is  debatable,  or  they  are 
defined  so  rigidly  that  they  fall  to  produce  decisions  that  are  appropriately  sensitive  to  new  context. 


3.4  Bottom-Up  Approaches 


The  bottom-up  approaches  to  building  AMAS  are  inspired  by  three  sources:  (1)  the  tinkering  by 
engineers  as  they  optimize  system  performance,  (2)  evolution,  and  (3)  learning  and  development  in 
humans.  Bottom-up  approaches  fall  within  two  broad  categories:  the  assembling  of  systems  with 
complex  faculties  out  of  discrete  subsystems,  and  the  emergence  of  values  and  patterns  of  behavior 
in  a  more  holistic  fashion,  as  in  artificial  life  experiments  and  connectionist  networks. 

A  variety  of  discrete  subsystems  are  being  developed  by  computer  scientists  that  could  potentially 
contribute  to  the  building  of  artificial  moral  agents.  Not  all  of  these  subsystems  are  explicitly 
designed  for  moral  reasoning.  For  example,  learning  algorithms,  affective  sensors,  and  social 
mechanisms  might  all  contribute  to  the  moral  acumen  of  a  robot.  But  computer  scientists  who  wish 
to  build  robots  with  higher-order  faculties  out  of  discrete  subsystems  are  confronted  with  a  difficult. 
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and  perhaps  insurmountable,  challenge  of  assembling  components  into  a  functional  whole.  Whether 
the  aggregation  of  discrete  skill  sets  will  lead  to  the  emergence  of  higher-order  cognitive  faculties— 
including  emotional  intelligence,  moral  judgment,  and  consciousness— can  only  be  known  once 
roboticists  go  through  the  exercise  of  building  the  systems. 

3.4.1  Optimizing  Performance 

Various  trial-and-error  techniques  are  available  to  engineers  for  progressively  tuning  components  so 
that  the  system  approaches  or  surpasses  the  performance  criteria.  Bottom-up  approaches  to  ethics 
treat  normative  values  as  being  implicit  in  the  activity  of  agents  rather  than  explicitly  articulated  (or 
even  articulatable)  in  terms  of  a  general  theory.  Engineers  commonly  define  tasks  atheoretically 
using  a  performance  measure,  such  as  winning  chess  games,  passing  the  Turing  test,  walking  across  a 
room  without  stumbling,  and  so  on.  Even  without  a  theory  of  the  best  way  to  decompose  the  task 
into  subtasks,  engineers  can  achieve  a  high  level  of  performance  on  many  tasks.  Sometimes  a  post 
hoc  analysis  of  the  system  can  produce  a  theory  or  specification  of  how  the  subtasks  yield  results. 
But  often  the  results  of  such  an  analysis  do  not  correspond  to  the  kind  of  decomposition  suggested 
by  a  priori  theorizing. 

3.4.2  Evolution 

Evolution  has  inspired  an  array  of  approaches  for  developing  artificial  intelligence  from  artificial  life 
experiments  (Alife)  to  genetic  algorithms  and  to  evolutionary  robotics.  The  theory  of  evolution  has 
suggested  to  engineers  a  model  for  self-selecting  and  self-organizing  systems  that  strive  toward  the 
optimization  of  some  performance  criteria,  such  as  the  maximization  of  profits.  The  power  of 
evolution  is  tapped  into  by  selecting  those  agents,  from  a  collection  of  similar  agents,  that  are  most 
successful  at  optimizing  a  specified  fitness  (performance)  criterion.  The  selected  agents  serve  as 
parents  that  are  modified  and  recombined  (using  a  process  that  is  analogous  to  sexual  reproduction) 
to  produce  a  new  generation  of  agents.  This  new  generation  is  tested,  the  best  performers  selected, 
and  they  in  turn  breed,  and  so  forth.  This  basic  strategy  has  been  successful  for  producing  agents 
suited  to  a  wide  variety  of  tasks. 

Two  ideas  contribute  to  the  belief  that  evolutionary  strategies  would  be  helpful  for  eliciting  moral 
behavior  in  agents.  The  first  is  the  contention  by  game  theorists  and  evolutionary  psychologists  that 
moral  propensities,  such  as  cooperation  and  care  of  the  young,  may  have  emerged  during  the  course 
of  evolution  are  partially  encoded  in  genes  and  potentially  reproducible  In  simulations  of  evolution 
within  computer  environments.  However,  as  Rodney  Brooks  has  noted,  experiments  in  Alife  "have 
not  taken  off  by  themselves  in  the  ways  we  have  come  to  expect  of  biological  systems"  [Brooks, 
2002].  The  second  influencing  idea  is  that  optimizing  moral  performance  might  be  used  as  the 
fitness  criteria  for  selecting  the  best  agents.  The  difficulty  with  this  strategy  lies  in  how  the  fitness 
criteria  would  be  represented  in  a  computational  system.  The  slogan  'survival  of  the  most  moral' 
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highlights  the  problem  of  saying  what  'most  moral'  amounts  to  in  a  non-circular  (and 
computationally  tractable)  fashion. 

3.4.3  Learning  and  Development 

Alan  Turing  was  the  first  to  broach  the  idea  that  artificial  intelligence  (Al)  should  try  to  mimic  child 
development.  In  1950  he  wrote:  "Instead  of  trying  to  produce  a  programme  to  simulate  the  adult 
mind,  why  not  rather  try  to  produce  one  which  simulates  the  child's?  If  this  were  then  subjected  to 
an  appropriate  course  of  education  one  would  obtain  the  adult  brain"  [Turing,  1950]. 

Jean  Piaget,  Lawrence  Kohiberg,  Carol  Gilligan  and  others  have  proposed  developmental  theories 
regarding  the  way  in  which  children  learn  about  morality  [Murray,  2008].  These  theories  have  been 
adapted  into  curricula  that  facilitate  the  moral  development  of  children.  This  suggests  the  possibility 
that  a  learning  robot  might  be  taken  through  a  similar  educational  program.  However,  while 
machine  learning  is  an  important  area  of  research,  the  algorithms  and  techniques  presently  available 
are  not  robust  enough  for  such  a  sophisticated  educational  project.  For  the  immediate  future, 
machine-learning  techniques  are  likely  to  be  quite  rudimentary. 

3.4.4  The  Value  and  Limits  of  Bottom-up  Approaches 

Individual  subsystems  can  be  quite  brittle  in  their  performance.  However,  when  integrated 
successfully,  these  components  can  give  rise  to  complex  dynamic  systems  with  a  range  of  choices  or 
optional  responses  to  external  conditions  and  pressures.  Bottom-up  engineering  thus  holds  the 
promise  of  a  kind  of  dynamic  morality  where,  as  conditions  change,  the  ongoing  feedback  from 
different  mechanisms  facilitates  varied  responses.  It  ties  into  a  movement  within  ethics  termed 
'particularism',  which  asserts  that  no  general  laws  or  rules  are  possible,  and  each  ethical  situation  Is 
unique. 

But  the  weakness  of  bottom-up  approaches  for  developing  AMAs  lies  in  not  knowing  which  goals  to 
use  for  evaluating  choices  and  actions  as  contexts  and  circumstances  change.  Bottom-up  systems 
work  best  when  they  are  directed  at  achieving  one  clear  goal.  When  the  system  has  more  than  one 
goal,  or  when  the  available  information  Is  confusing  or  Incomplete,  bottom-up  engineering  is  less 
likely  to  provide  a  clear  choice  or  course  of  action. 


3.5  Supra-Rational  Faculties 


In  order  to  function  as  moral  agents,  robots  that  interact  with  humans  within  dynamic  multi-agent 
contexts  may  require  other  skill  sets  in  addition  to  being  rational.  Which  skills  the  agent  will  need 
will  vary  depending  upon  the  robot's  tasks  and  goals.  For  example,  tasks  that  socially-viable  robots 
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will  perform  can  require  emotional  intelligence,  knowledge  about  social  customs,  and  the  non-verbal 
cues  used  to  communicate  essential  information.  In  addition,  the  capacity  to  appreciate  and 
respond  to  moral  challenges  may  also  depend  upon  the  robot  having  semantic  understanding, 
consciousness,  a  theory  of  mind  (the  ability  to  deduce  the  intentions,  desires,  and  goals  of  others), 
and  perhaps  even  the  capacity  to  feel  pain  or  empathy.  These  additional  faculties  are  a  tall  order  for 
roboticists,  although  each  has  already  stimulated  interesting  lines  of  research  that  are  under  way. 

Algorithms  for  reasoning  about  moral  challenges  will  not  lead  to  appropriate  behavioral  responses 
unless  the  robot  has  access  to  the  background  information  describing  the  situation,  the  ability  to 
discern  which  information  is  essential  and  which  inputs  are  of  ethical  concern,  and  the  capacity  to 
recognize  inherent  and  potential  conflicts  arising  from  the  competing  interests  of  the  various  agents. 
In  other  words,  the  engineer  must  determine  what  the  Information  requirements  are  for  a  system 
making  moral  decisions.  What  will  the  system  need  to  know  in  order  to  make  an  informed  decision? 
What  input  devices  and  sensors  will  it  need  to  get  access  to  this  information? 

Supra-rational  faculties— such  as  emotions,  being  embodied  in  the  world,  social  skills,  and 
consciousness—  represent  ways  that  humans  get  access  to  essential  information  that  must  be 
factored  into  ethically-significant  choices.  Sensory  experience  and  social  mechanisms  contribute  to 
various  refinements  of  behavior  that  people  expect  from  each  other;  they  also  will  be  necessary  for 
robots  that  function  to  a  high  degree  of  competence  in  social  contexts.  While  robots  will  not 
necessarily  need  to  emulate  the  full  array  of  human  faculties,  the  more  sophisticated  systems  will 
need  mechanisms  that  provide  a  similar  appreciation  of  complex  social  contexts.  Furthermore, 
communicating  through  facial  expressions,  gestures,  vocal  intonation  and  prosody,  and  other  verbal 
and  non-verbal  cues  will  be  helpful  in  conveying  the  robot's  intentions  and  facilitating  cooperation 
with  humans.  This  will.  In  turn,  help  humans  to  perceive  the  robot  as  being  trustworthy. 

Given  that  morally  Intelligent  behavior  may  require  much  more  than  being  rational,  the  challenge  of 
building  AMAs  is,  from  this  perspective,  a  problem  of  moral  psychology,  not  moral  calculation.  For 
designers  of  morally  Intelligent  systems,  the  challenge  Is  not  how  to  give  them  abstract  theoretical 
knowledge  but  how  to  develop  robots  that  embody  the  right  tendencies  in  their  reactions  to  the 
world  and  other  agents  in  that  world. 


3.6  Hybrid  Systems 


Moral  judgment  in  humans  Is  a  hybrid  of  both  (1)  bottom-up  mechanisms  shaped  by  evolution  and 
learning  and  (2)  top-down  criteria  for  reasoning  about  ethical  challenges.  Eventually,  we  may  be 
able  to  build  morally  intelligent  robots  that  maintain  the  dynamic  and  flexible  morality  of  bottom-up 
systems  capable  of  accommodating  diverse  inputs,  while  subjecting  the  evaluation  of  choices  and 
actions  to  top-down  principles.  The  prospect  of  developing  virtuous  robots  offers  one  venue  for 
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considering  the  integration  of  top-down,  bottom-up,  and  supra-rational  mechanisms. 

3.6.1  Virtue  Ethics:  The  Virtuous  Robot 

There  is  a  foundational  critique  of  all  procedural  ethics,  i.e.,  any  approach  that  claims  morality  is 
determined  by  following  the  proper  rules.  Many  contemporary  ethicists  claim  that  all  procedural 
ethics  fail,  because  so  many  theorists  have  explicitly  abandoned  the  ideas  that  in  ethics:  (a)  the  rules 
would  amount  to  a  decision  procedure  for  determining  what  the  right  action  would  be  in  any 
particular  case;  and  (b)  the  rules  would  be  stated  in  such  terms  that  any  non-virtuous  person  could 
understand  and  apply  them  correctly. 

In  robotics,  so-called  Jriendliness  theory'  attempts  to  deal  with  this  conundrum:  rather  than  using 
any  finite  set  of  top-down  rules  or  laws,  intelligent  machines  should  be  programmed  to  be  basically 
altruistic,  and  then  use  machine  learning  in  various  settings  to  create  a  kind  of  'best  judgment'  in 
how  to  carry  out  properly  altruistic  actions.  This  approach  sidesteps  the  fundamental  calculatlonal 
and  programming  problem  of  how  to  account  for  a  vast  number  of  unforeseeable  eventualities. 
However,  this  theory  has  a  problem  with  military  robots:  we  would  not  want  them  to  always  act 
altruistically  towards  some  humans.  In  fact,  we  would  want  them  to  be  able  to  kill  the  right  humans 
and  not  the  wrong  (friendly)  ones.  Therefore,  we  need  an  approach  that  enables  machines  to  use  a 
basic  top-down  program  plus  bottom-up  machine  learning  to  be  able  to  function  excellently  in  its 
military  roles  and  without  malfunctioning;  it  should  be  fierce  towards  its  enemies,  helpful  to  its 
allies,  and  reliable  in  discerning  the  difference,  including  in  situations  unforeseen  by  its 
programmers.  What  ethical  approach  can  accomplish  all  this? 

Perhaps  the  most  viable  hybrid  approach  that  avoids  the  conflict  between  duties  and  consequences, 
and  incorporates  both  warrior  fierceness  towards  enemies  and  a  gentle  kindness  towards  comrades, 
is  virtue  ethics:  an  approach  that  sees  ethics,  not  in  terms  of  what  rules  should  be  followed,  but  in 
terms  of  what  kind  of  character  an  agent  has— does  one  have  a  virtuous  character,  or  is  one  full  of 
vice?  For  virtue  ethics,  morality  is  not  a  function  of  actions  but  of  character.  That  is,  one's  actions 
do  not  constitute  one's  morality  but  rather  reveal  it:  ethics  is  agent-centered,  not  act-centered.  The 
proper  moral  question  is  not  "what  rule  should  I  follow?",  or  "what  rules  apply  to  this  act",  but 
instead  "what  sort  of  person  will  I  reveal  myself  to  be  (or  become)  if  this  Is  the  sort  of  thing  I  do?" 
What  would  doing  this  act  say  about  my  character? 

While  virtue  theorists  differ  in  their  list  of  virtues,  they  take  their  lead  from  Aristotle  in  recognizing 
that  the  virtues  are  acquired  developmentally  through  experience  and  the  cultivation  of  good  habits. 
This  emphasis  on  developing  the  virtues  can  be  understood  as  bottom-up  learning,  while,  at  least  in 
theory,  it  is  possible  to  consider  the  virtues  as  top-down  patterns  for  evaluating  actions  programmed 
into  a  robot.  Because  virtue  is  an  'excellence'  and  defined  in  terms  of  the  roles  one  plays,  it  is 
inescapably  context-dependent;  no  single  rule  or  set  of  rules  will  be  able  to  dictate  what  different 
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persons  (or  robots)  in  different  roles  will  need  to  do  in  different  situations.  Moral  criteria  are 
thereby  objective  but  not  categorical  rules;  instead,  they  are  what  Kant  called  'hypothetical 
imperatives'  linking  good  means  to  good  ends  [Foot,  1972]. 

Because  the  virtues  are  objectively-beneficial  habits  for  proper  functioning,  but  are  role  dependent, 
the  objective  list  of  virtues  for  firemen  will  be  different  than  the  list  for  auditors  or  salesmen  or 
soldiers,  and  so  on.  Only  the  most  generic  virtues— e.g.,  wisdom,  honesty,  empathy,  justice,  etc.— 
will  apply  to  all  social  roles.  Professional  codes  are  then  best  understood  as  list  of  virtues  for  a 
particular  social  role,  rather  than  a  list  of  rules  to  follow.  Thus,  following  Solomon  [1988],  we  can  say 
that  good  eyesight  is  a  virtue  In  a  rifleman;  It  Is  a  virtue  because  it  helps  in  achieving  the  purposes  or 
goals  of  a  rifleman.  But  while  the  lack  of  a  properly  developed  conscience  might  be  thought  of  as  a 
virtue  in  a  hitman  understood  narrowly  within  that  particular  social  role,  It  is  not  a  virtue  in  a  person 
simply  described  as  a  person,  within  the  all-encompassing  set  of  social  roles  we  call  human  life.  A 
true  virtue  is  thus  an  excellence  in  a  role  that  aids  overall  human  flourishing. 

3.6.2  The  Top-Down  Challenge  and  the  Bottom-Up  Approach 

The  top-down  challenge  for  an  engineer  designing  a  robot  would  be  to  determine  how  to  represent 
virtuous  patterns  and  motivations,  and  how  the  system  would  determine  which  virtue,  or  which 
action  representing  the  virtue  should  be  called  upon  in  a  particular  situation.  Given  the  emotional 
grounding  of  virtuous  motivations  in  human  beings,  a  designer  of  a  virtuous  AMA  might  need  to 
decide  whether  a  virtuous  machine  would  also  need  emotions  of  its  own  or  some  mechanisms 
functionally  similar  to  human  emotions. 

The  bottom-up  approach  to  implementing  virtues  in  computational  systems  arises  from  the 
recognition  by  several  theorists  [e.g.,  DeMoss  1998;  Churchland,  1995]  of  the  similarity  between 
learning  in  connectionist  networks  and  Aristotle's  discussion.  In  the  Nicomachean  Ethics,  regarding 
the  way  In  which  the  virtues  are  acquired.  Connectionist  networks  provide  a  bottom-up  strategy  for 
build  ng  capacities  through  the  recognition  of  patterns  and  the  building  of  categories  out  of  complex 
inputs.  Through  the  gradual  accumulation  of  data,  the  network  develops  generalized  responses  that 
go  beyond  the  particulars  on  which  it  is  trained.  One  difficulty  with  learned  patterns  that  emerge 
from  connectionist  systems  Is  that  they  are  not  accompanied  by  explanation  for  why  the  action  was 
chosen. 

The  problems  tackled  by  existing  connectionist  networks  are  far  from  the  complex  learning  tasks 
associated  with  moral  development.  However,  the  prospect  that  neural  networks  might  be  adapted 
for  some  aspects  of  moral  reasoning  is  an  intriguing  possibility.  Neural  networks  offer  an  approach, 
deserving  of  attention,  for  developing  robots  that  embody  the  right  tendencies  in  their  reactions  to 
the  world.  The  bottom-up  development  of  virtuous  patterns  of  behavior  might  be  combined 
together  with  a  top-down  implementation  of  the  virtues  as  a  way  of  both  evaluating  the  actions  and 
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as  a  vehicle  for  providing  rational  explanations  of  the  behavior. 

While  many  technological  thresholds  must  be  crossed  before  the  development  of  a  virtuous  robot 
becomes  a  serious  possibility,  we  believe  that  this  approach  to  building  AMAs  should  be  of  particular 
interest  to  the  military  in  its  long-term  planning.  A  virtuous  robot  might  emulate  the  kind  of 
character  that  the  armed  forces  value  in  their  personnel.  Furthermore,  virtues— deeply  rooted  in  the 
foundational  attitudes  and  structures  of  an  agent— provide  a  certain  degree  of  stability,  and  the 
prospect  that  officers  can  rely  upon  the  performance  of  the  artificial  agents  they  deploy. 


3.7  First  Conclusions:  How  Best  to  Program  Ethical  Robots 


A  top-down  approach  would  program  rules  into  the  robot  and  expect  the  robot  to  simply  obey  those 
rules  without  change  or  flexibility.  The  downside,  as  we  saw  with  the  analogous  deontological 
ethics,  is  that  such  rigidity  can  easily  lead  to  bad  consequences  when  events  and  situations 
unforeseen  or  insufficiently  imagined  by  the  programmers  occur,  causing  the  robot  to  perform  badly 
or  simply  do  horrible  things,  precisely  because  it  is  rule-bound. 

A  bottom-up  approach,  on  the  other  hand,  depends  on  robust  machine  learning:  like  a  child,  a  robot 
is  placed  into  variegated  situations  and  is  expected  to  learn  through  trial  and  error  (and  feedback) 
what  is  and  is  not  appropriate  to  do.  General,  universal  rules  are  eschewed.  But  this  too  becomes 
problematic,  especially  as  the  robot  is  introduced  to  novel  situations:  it  cannot  fall  back  on  any  rules 
to  guide  it  beyond  the  ones  it  has  amassed  from  its  own  experience,  and  if  those  are  insufficient, 
then  it  will  likely  perform  poorly  as  well. 

As  a  result,  we  defend  a  hybrid  architecture  as  the  preferred  model  for  constructing  ethical 
autonomous  robots.  Some  top-down  rules  are  combined  with  machine  learning  to  best  approximate 
the  ways  in  which  humans  actually  gain  ethical  expertise.  We  humans  are  hard-wired  with  various 
rules  through  our  evolutionary  heritage,  but  these  vastly  underdetermine  actual  behavior;  hence 
responsible  behavior  builds  on  these  underlying  (largely  unconscious)  rules  with  a  healthy  dose  of 
indoctrination  and  peer  interaction  and  all  the  other  types  of  learning  that  children  do.  As  a  result,  a 
character  evolves:  a  tendency  to  perform  certain  roles  in  the  evolving  ecology  of  social  life,  and 
either  to  fail  or  to  perform  excellently  in  those  roles. 

3. 7.1  Further  Conclusions  on  Ethical  Theory  and  Robot:  Military  Implications 

Autonomous  robots  both  on  and  off  the  battlefield  will  need  to  make  choices  in  the  course  of 
fulfilling  their  missions.  Some  of  those  choices  will  have  potentially  harmful  consequences  for 
humans  and  other  agents  worthy  of  moral  consideration.  Even  though  the  capacity  to  make  moral 
judgments  can  be  quite  complex,  and  even  though  roboticists  are  far  from  substantiating  the 
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collection  of  affective  and  cognitive  skills  necessary  to  build  AMAs,  systems  with  limited  moral 
decision-making  abilities  are  more  desirable  than  'ethically  blind'  systems.  The  military's  comfort 
with  the  robots  it  deploys,  and  ultimately  the  comfort  of  the  public,  will  depend  upon  a  belief  that 
these  systems  will  honor  basic  human  values  and  norms  in  their  choice  of  actions.  Given  the 
prospect  that  robotic  systems  can  reduce  the  loss  of  personnel  during  combat,  one  can  presume  that 
the  development  of  autonomous  robotic  fighting  machines  will  proceed.  However,  if  semi- 
autonomous  and  autonomous  robotic  systems  are  deployed  as  lethal  weapons,  it  goes  without 
saying  that  commanders  will  need  to  be  confident  that  the  systems  will  only  wield  their  destructive 
might  on  designated  targets. 

The  challenge  for  the  military  will  reside  in  preventing  the  development  of  lethal  robotic  systems 
from  outstripping  the  ability  of  engineers  to  assure  the  safety  of  these  systems.  Implementing  moral 
deci.sion-making  faculties  within  robots  will  proceed  slowly.  While  there  are  aspects  of  moral 
judgment  that  can  be  isolated  and  codified  for  tightly  defined  contexts,  moral  intelligence  for 
autonomous  entities  is  a  complex  activity  dependent  on  the  integration  of  a  broad  array  of  discrete 
skills.  Robots  Initially  will  be  built  to  perform  specified  tasks.  However,  as  computer  scientists  learn 
to  build  more  sophisticated  systems  that  can  analyze  and  accommodate  the  moral  challenges  posed 
by  new  contexts,  autonomous  robots  can  and  will  be  deployed  for  a  broad  array  of  military 
applications.  So  for  the  foreseeable  future  and  as  a  more  reasonable  goal,  it  seems  best  to  attempt 
to  program  a  virtuous  portiol  character  into  a  robot  and  ensure  it  only  enters  situations  in  which  its 
character  can  function  appropriately. 

Theorists  continue  to  debate  whether  strong  artificial  intelligence  is  possible  [e.g.,  Searle,  1980; 
Russell  and  Norvig,  2003].  However,  even  Al  systems  with  more  limited  intelligence  will  require  some 
degree  of  moral  sensitivity  In  the  choices  and  actions  they  take:  "If  there  are  limitations  in  the  extent 
to  which  scientists  can  implement  moral  decision  making  capabilities  in  Al,  it  is  incumbent  to 
recognize  those  limitations,  so  that  military  planners  do  not  rely  inappropriately  on  artificial  decision 
makers"  (Wallach  et  al.,  2008]. 

For  military  robots,  that  virtuous  character  will  likely  involve  ensuring  that  the  LOW  and  ROE  are 
programmed  in  (which  may  differ  from  mission  to  mission)  and  steadfastly  obeyed,  as  a  proxy  for  a 
full-fledged  morality.  Such  an  approach  has  several  advantages.  First,  any  problems  from  moral 
particularism  or  other  problems  with  general  ethical  principles  (including  misguided  moral  relativism) 
are  skirted.  Second,  the  relationship  of  morality  to  legality— a  minefield  for  ethics— is  likewise 
largely  avoided;  the  LOW  and  ROE  make  clear  what  actions  are  legal  and  illegal  for  robots;  and  for 
military  situations,  that  can  serve  as  a  reasonable  approximation  to  the  moral-immoral  distinction. 
So  the  background  of  ethics  for  autonomous  robots  In  the  military  can,  at  least  for  now,  become  part 
of  our  discussion  about  the  programmability  of  the  LOW  and  ROE.  What  this  means  for  how  we 
should  program  ethical  robots,  and  the  implications  of  this  approach  for  the  Laws  of  War  and  the 
ethics  of  risk,  is  examined  in  the  next  section  of  this  report. 
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4.  The  Laws  of  War  and  Rules  of  Engagement 


For  any  of  the  ethical  frameworks  we  have  identified  in  the  previous  section— deontological  ethics, 
consequentialism/utilitarianism,  virtue  ethics— the  current  state  of  robotics  programming  (the  Al  or 
control  software  in  robots)  is  not  yet  robust  enough  to  fully  accommodate  them.  Nevertheless, 
understanding  those  ethical  theories  now  is  essential  for  illuminating  a  thoughtfully-planned  path 
with  respect  to  developing  ethical  behavior  in  robots.  In  the  meantime,  for  military  robots,  a 
reasonable  proxy  for  any  such  ethical  theory  seems  to  be  found  in  the  Laws  of  War  (LOW)  and  Rules 
of  Engagement  (ROE)— an  alternative  programming  approach  with  several  advantages,  as  explained 
at  the  end  of  the  last  section;  but,  as  we  explain  here,  it  also  has  its  shortcomings.  In  this  section,  we 
turn  to  the  LOW  and  ROE,  including  their  relation  to  just-war  theory,  and  their  suitability  as  an 
interim  programming  solution. 


4.1  Coercion  and  the  LOW 


To  understand  the  LOW  and  ROE,  and  to  evaluate  their  viability  as  a  programming  approach,  we 
must  first  understand  their  origins  in  just-war  theory  and,  even  more  basic,  the  nature  of  warfare, 
i.e.,  what  do  we  need  LOW  and  ROE  in  first  place,  and  why  can't  we  say  'anything  goes'  in  war? 

War,  however  regrettable,  has  been  an  inescapable  aspect  of  human  life  to  date.  Autonomous 
robots  have  the  capacity  to  radically  change  the  nature  of  war,  and  perhaps  even  eventually  lead  to 
its  cessation.  But  during  the  'growing  pains'  of  robotics  development,  our  autonomous  machines 
and  systems  could  make  the  horrors  of  war  either  much  better  or  much  worse;  hence,  the  ethics  of 
robotic  war  will  be  one  of  the  most  important  subjects  of  the  next  decades  of  the  future.  To 
understand  the  nature  of  war,  we  can  see  it  as  a  type  of  forcible  coercion  that  nations  engage  in  as  a 
means  of  attaining  their  political  goals.  Let  us  define  the  term  as  follows: 

Coercion.  The  use  of  force  and  or  violence,  or  the  threat  thereof  (i.e.,  intimidation),  in  order  to 
persuade.  Coercion  Is  a  sad  reality  both  within  societies  and  in  international  affairs.  Within 
recognized  societies,  legitimate  coercion  is  exercised  by  the  state,  through  its  police  and  judiciary,  to 
help  restrain  and  deter  illegitimate  coercion  by  individuals.  But  in  the  international  arena,  no  supra¬ 
national  institution  has  clear  and  effective  coercive  power  over  nation-states  who  perform 
illegitimately  coercive  acts.  Hence,  states  must  resolve  issues  of  illegitimate  coercion  amongst 
themselves,  often  through  coercion  of  their  own.  Hence,  we  have  the  phenomenon  of  war:  armed 
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conflict  between  states,  which  attempts  to  coerce  some  desired  outcome  in  lieu  of  other  means 
(e.g.,  negotiations)  of  attaining  international  agreement. 

Naturally,  if  states  are  engaged  in  legitimate  forcible  coercion  in  order  to  deter  or  punish  illegitimate 
coercion,  then  we  must  have  some  agreed  upon  means  of  distinguishing  legitimate  from  illegitimate 
coercion  amongst  states  in  war.  This  is  called  'just-war  theory',  and  it  attempts  to  spell  out  when 
beginning  the  coercion  of  war  is  morally  legitimate  and  when  it  is  not  (termed  jus  ad  bellum);  and 
further,  what  means  of  wartime  coercion  are  morally  permitted  (jus  in  bello)  and  what  one  should  do 
in  the  aftermath  of  officially  ending  such  coercion  (Jus  post  bellum). 


4.2  Just-War  Theory  and  the  LOW 


So,  the  Laws  of  War,  also  known  as  the  Laws  of  Armed  Conflict  (LOAC),  concern  the  legal  and  moral 
legitimacy  of  practices  that  nations  engage  in  during  the  interstate  forcible  coercion  that  we  call 
'war'  As  mentioned,  the  Laws  of  War  are  divided  into  three  basic  categories,  with  the  first  two 
being  of  general  and  long-standing  acceptance,  but  the  third  forming  a  relatively  new  emphasis, 
albeit  of  increasing  import  in  contemporary  asymmetric  and  non-state  warfare: 

1.  Jus  ad  bellum:  Law  concerning  acceptable  justifications  to  use  armed  force  and  declare  war. 

2.  Jus  In  bello:  Law  concerning  acceptable  conduct  In  war,  once  it  has  begun. 

3.  JUS  post  bellum:  Law  concerning  acceptable  conduct  following  the  official  or  declared  end  of  a 
war  (including  occupations  and  indefinite  ceasefires,  the  acceptance  of  surrender,  and  the 
treatment  and  release  of  prisoners  of  war  (POWs)  and  enemy  (non-)combatants  after  conflict 
has  officially  ceased). 

These  three  categories  are  typically  (but  not  always)  asserted  to  be  independent;  so,  the  morality 
and  legality  of  a  state  deciding  to  go  to  war  (jus  ad  be//um)— typically  a  political  decision  made  by  a 
state's  political  leadership— have  long  been  considered  independent  of  the  morality  and  legality  of 
one's  actions  in  waging  war  (jus  in  bello);  the  latter  is  typically  the  province  of  a  state's  professional 
military,  not  its  political  leadership.  For  instance,  we  might  hold  that  an  American  soldier  who 
participated  in  the  My  Lai  massacre  was  guilty  of  war  crimes  (a  violation  of  jus  in  bello),  but  not 
because  the  Vietnam  War  was  itself  unjust  (even  assuming  that  armed  conflict  was  a  violation  of  jus 
ad  bellum).  Likewise,  one  might  have  fought  a  just  war  and  done  so  in  a  just  fashion,  but  it  may  still 
impose  unjust  conditions  on  the  vanquished,  thus  violating  jus  post  bellum. 


4.3  Just-War  Theory:  Jus  ad  Bellum 
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A  traditional  emphasis  of  just-war  theory  concerns  when  it  is  morally  acceptable  for  a  state  to  begin 
or  participate  in  the  extreme  forcible  coercion  that  is  war,  that  \s,jus  od  bellum.  The  ancient  Greeks 
(Aristotle)  and  Romans  (such  as  Augustine)  considered  these  issues,  but  the  natural  law  tradition 
associated  with  Aquinas  began  the  systematic  consideration  of  the  issue.  Natural  law  and  social 
contract  theorists  have  continued  it  in  the  work  of  such  luminaries  as  Vitoria,  Grotius,  Locke,  and 
Kant;  the  20^^  century  adapted  this  just-war  tradition  in  gradually  creating  the  internationally 
accepted  LOW.  Hence,  a  brief  explanation  of  just-war  theory  is  needed;  current  influential  theorists 
include  Walzer,  Orend,  and  O'Brien,  with  a  rough  consensus  on  the  following  as  necessary  conditions 
for  moral  jus  od  bellum: 

a.  Proper  authority.  War  must  be  waged  by  a  competent  authority  (normally  an  Internationally 
recognized  state)  for  a  publicly  stated  purpose,  i.e.,  'secret  wars'  are  immoral.  But  this  poses  a 
possible  dilemma:  Would  then  all  revolutions  be  immoral?  This  requirement  of  jus  od  bellum 
has  considerable  difficulty  in  defining  any  non-state  rebellions  (including  popular  revolutionary 
movements)  as  moral.  Compare  this  to  the  problem  of  distinguishing  between  'freedom 
fighters',  terrorists,  and  mere  criminal  behavior. 

b.  Just  couse.  There  must  be  sufficient  and  acceptable  justifications  for  entering  war.  Specifically, 
the  war  must  be  in  self-defense,  against  unjust  attacks  on  Innocent  citizens  or  states,  to  restore 
rights  wrongfully  denied  and  to  re-establish  a  just  order  (against  unjust  rebellion).  When  a  state 
has  forfeited  its  moral  right  to  govern  its  people— so  it  is  no  longer  a  'minimally-just  state'— 
other  nations  may  invade  it  in  order  to  carry  out  humanitarian  interventions  in  the  self-defense 
of  its  people,  e.g.,  in  Kosovo  or  Darfur.  The  state,  no  longer  being  minimally  just,  has  forfeited  its 
own  right  to  self-defense.  Problem:  In  addition  to  the  obvious  challenge  of  determining  when  a 
state  is  no  longer  'minimally  just',  developments  in  non-state  warfare,  especially  terrorism, 
complicate  this  requirement. 

However,  offensive  wars  may  be  justified  if  to  enforce  justice  for  oneself.  Problem:  The  so-called 
'Bush  Doctrine'  and  other  policies  In  modern  warfare  that  justify  a  preemptive  war  against 
looming  threats  would  fail  the  usual  interpretation  of  having  a  just  cause  for  war.  Current 
scholarship  thus  focuses  on  the  proper  Interpretation  of  self-defense  against  a  merely  potential, 
but  not  actual,  threat;  common  criteria  include  the  imminence  and  seriousness  of  the  threat. 
(See  section  6  on  risk  assessment  for  more.) 

3.  Proportionality,  The  good  achieved  by  war  must  be  proportional  to  the  evil  of  waging  it. 
Therefore,  it  is  immoral  to  wage  a  massive  war  to  remedy  a  small  wrong  (e.g.,  the  'Soccer  War' 
of  1969  between  Honduras  and  El  Salvador). 
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4.  Lost  resort.  Peaceful  means  of  avoiding  war  have  been  exhausted,  e.g.,  negotiations  must  have 
oeen  tried  and  have  failed;  thus,  war  is  acknowledged  as  a  last  resort.  Problem:  This  again 
makes  any  so-called  pre-emptive  war  problematic— after  all,  how  can  one  side  be  sure  that 
negotiations  have  completely  failed,  until  the  other  side  actually  attacks? 

5.  Reosonoble  success.  This  requirement  asserts  that  there  is  no  point  fighting  a  war  one  cannot 
possibly  win.  Because  the  cost  of  war  is  so  terrible,  it  is  immoral  to  fight  by  futile  coercion  with 
no  possibility  of  attaining  one's  goals,  since  that  would  lead  to  unnecessary,  useless  casualties; 
so  one  must  resist  in  some  other  way. 

6.  Right  intention.  Finally,  there  must  be  a  subjective  as  well  as  objective  moral  rightness  in 
entering  a  war.  One  must  have  the  morally-correct  motivation  and  mindset  in  engaging  in  war, 
rather  than  illegitimate  goals  (e.g.,  revenge  or  economic  gain)  in  mind.  For  example,  to  attack 
the  enemy  in  self-defense,  with  the  intent  to  merely  gain  victory  and  (a  lasting?)  peace,  would  fit 
the  requirement  of  right  intention;  to  perform  exactly  the  same  actions,  but  with  the  mindset  of 
merely  satisfying  a  violent  bloodlust,  or  gaining  control  of  valuable  properties  such  as  oil,  would 
fail  this  requirement. 

4.3.1  Robots  one/  Jus  ad  Bellum 

Pete'  Asaro  [2007]  raises  an  objection  to  the  use  of  robots  in  war,  that  the  development  of  military 
robots  seems  to  fail  a  jus  od  bellum  test,  because  they  would  embolden  political  leaders  to  wage 
war;  robotic  soldiers  would  lower  barriers  to  entering  a  war,  since  they  would  reduce  casualties 
among  human  soldiers  and  therefore  also  a  significant  political  cost.  Belatedly,  Sparrow  [2007]  and 
Sharkey  (2007a]  object  to  the  wartime  use  of  robots,  because  they  would  make  war  (more)  risk-free, 
at  least  on  the  deploying  side,  but  war  morally  requires  there  be  a  terrible  cost  so  that  political 
Iead6?rs  do  not  choose  it  so  casually. 

Note  that  this  argument  is  indirect:  no  one  seriously  contends  the  robots  themselves,  particularly  if 
programmed  with  a  suitable  'slave  morality',  will  themselves  be  directly  effecting  jus  od  bellum 
violations.  Rather,  autonomous  robots,  with  their  promise  of  fewer  human  casualties,  will  make  war 
less  terrible  and  therefore  more  tempting,  plausibly  enticing  political  leaders  to  wage  war  more 
readily.  But  such  an  argument  has  multiple  flaws.  First,  to  claim  that  robots  have  bad  consequences 
for  declaring  war  is  a  consideration  that  would  be  handled  by  the  non-consequentialist  requirements 
for  declaring  a  just  war:  using  robots  or  not  makes  no  difference  as  to  whether  the  war  is  (a)  in  self- 
defense,  (b)  proportionally  achieving  a  good  greater  than  the  evil  of  war,  (c)  a  last  resort,  and  so 
forth. 

Second,  if  any  technology  (from  better  armor  to  longer-range  missiles)  makes  it  easier  to  enter  a  war 
to  the  extent  that  it  reduces  risks  on  our  side,  these  objections  seem  to  imply  that  we  should  not 
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make  any  improvements  in  the  way  we  prosecute  a  war  and,  indeed,  should  return  to  more  brutal 
methods  (e,g.,  bayonets).  But  surely  this  is  ridiculous  or,  at  the  least,  counterintuitive.  Indeed,  the 
increasing  horrors  of  war  have  reinforced  the  need  for  jus  ad  helium  and  Jus  in  hello  restrictions,  not 
undermined  them.  It  is  likely  the  advent  of  military  robots  will  cause  further  sophistication  in  such 
just-war  considerations  and  make  war  ever  more  ethically  waged,  as  is  indeed  a  goal  of  this  report. 

Further,  we  can  acknowledge  that  war  is  terrible  and  ought  to  be  avoided  whenever  morally 
possible,  but  at  the  same  time  we  can  adopt  a  'deterrence'  strategy  to  avoid  war:  to  create  such  an 
overwhelmingly-powerful  military  force  that  no  one  would  want  to  risk  a  war  with  us.  Granted,  this 
may  be  an  unrealistic  goal  and  may  merely  spark  an  arms  race;  but  (so  far)  this  approach  seems  to  be 
working  reasonably  well  with  nuclear  weapons— which  suggests  that  the  dream  of  a  'risk-free  war'  is 
unrealistic  as  well,  and  any  lowering  of  barriers  to  war  may  be  temporary  at  best,  If  even  significant. 
Therefore,  the  dream  of  incurring  no  friendly  casualties  in  war  still  remains  ever  elusive,  even  if 
robots  are  deployed  on  the  frontlines  first.  (We  will  discuss  this  and  other  objections  further  in 
section  7.) 


4.4  Just  -War  Theory:  Jus  in  Bello 


There  are  serious  issues  with  traditional  Jus  ad  helium,  and  the  doctrine  will  continue  to  evolve  as  the 
technology  and  asymmetric  nature  of  contemporary  warfare  change.  But  because  this  report 
concentrates  on  robotic  ethics,  and  especially  the  ethics  of  deploying  autonomous  robots  by  the 
military,  yus  ad  helium  issues  will  herein  be  dealt  with  only  insofar  as  they  affect  the  Jus  in  hello  use 
of  robots.  It  is  exceedingly  unlikely  in  the  near-  or  even  medium-term  that  robots  will  be  in  any  way 
responsible  for  declaring  war  or  even  inadvertently  starting  a  war,  and  the  moral  use  of  robots  in  Jus 
post  helium  situations  will  largely  flow  from  the  morality  of  using  them  in  hello.  Hence,  we  focus 
now  on  the  LOW  and  ROE  for  Jus  in  hello,  especially  with  respect  to  the  use  of  autonomous  robots. 

4.4.1  Total  War  Doctrine:  Is  There  Really  a  Jus  in  Bello.^ 

"War  is  hell",  reportedly  said  US  by  General  Sherman— and  he  destroyed  infrastructure  and  burned 
to  the  ground  the  cities  and  farms  of  civilians  in  Georgia  on  his  march  to  the  sea  [Davis,  1980]. 
Sherman  believed  that,  given  the  just  cause  he  had  in  waging  war,  he  was  permitted  nearly  any 
means  to  victory,  including  intentionally  harming  civilians.  By  World  War  2,  this  view  became  known 
as  'total  war'  doctrine,  espoused  by  those  who  saw  nothing  wrong  with  launching  V-2  rockets  on  the 
citizens  of  London,  or  firebombing  the  citizens  of  Dresden  or  Tokyo,  or  dropping  nuclear  weapons  on 
Hiroshima  and  Nagasaki.  This  view  asserts  that,  assuming  yus  ad  helium  is  satisfied,  there  are  no  Jus 
in  hello  restrictions.  That  is,  one  may  do  whatever  is  needed  to  win  the  victory  in  a  just  war,  in 
whatever  way  one  sees  fit;  our  enemies  have  forfeited  their  right  to  any  consideration  by  unjustly 
beginning  their  forcible  coercion,  and  deserve  whatever  they  get. 
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The  defenders  of  total  war  doctrine,  as  well  as  certain  'realist'  interpretations  of  state  sovereignty 
and  action,  sometimes  defend  their  view  by  taking  the  actual  state  of  war  to  be  the  absence  of  any 
moral  or  legal  structure  or  standing.  Accordingly,  they  regard  the  LOW  as  an  elaborate  public 
relations  fantasy  that  nations  sometimes  use  when  it  suits  their  Reolpolitik,  or  (less  cynically)  as 
simply  a  misconceived  enterprise  without  any  actual  theoretical  or  practical  grounding.  War,  these 
realists  claim,  is  an  inherently  amoral  enterprise,  and  the  laws  of  the  state  no  longer  apply  to  those 
waging  war  against  the  state,  as  they  have  rejected  any  social  contract  to  abide  by  civil  behavior; 
hence,  there  is  no  basis  for  any  moral  or  legal  code  concerning  warfare.  Laws  and  morality,  it  is 
claimed,  are  only  possible  with  a  settled  nation-state,  in  the  absence  of  war  and  with  the  expectation 
of  the  rule  of  law;  an  attempt  to  understand  the  morality  or  legality  of  war  is  then  to  attempt  the 
oxymoronic. 

On  this  view,  war  (unlike  usual  criminal  activity)  occurs  against  the  background  of  a  complete 
absence  of  normal  law  and  order;  hence,  it  becomes  absurd  to  define  'war  crimes'  as  if  they 
constitute  a  violation  of  the  proper  conduct  of  war  operations,  in  analogy  with  how  normal  'crime' 
violates  the  proper  functioning  of  a  peaceful  civilian  society.  War  is  not  merely  a  legally-defined 
'business  by  other  means'  but  instead  is  a  last  resort  of  a  sovereign  state  whose  peaceful  political  life 
(which  is  the  background  for  'normal'  crime)  is  at  risk.  Total  war  thus  eliminates  the  usual  jus  in  bello 
distinction  between  combatants  and  noncombatants,  seeing  all  those  who  help  the  opposing  state 
(or  merely  reside  within  it)  as  legitimate  targets  in  a  nation's  existential  struggle.  Total  war  thus 
undercuts  the  applicability  of  just-war  theory  to  the  actual  conduct  of  war:  it  denies  the  possibility  of 
any  obligatory  jus  in  bello  restrictions. 

But  this  view  appears  both  unrealistic  and  morally  indefensible.  While  it  is  true  that  the 
international  arena  is  not  yet  sufficiently  similar  to  a  well-governed  state  such  that  wars  are  simply 
considered  to  be  international  crimes  and  soldiering  is  merely  international  police  work,  it  is  also 
true  that  international  relations  are  hardly  a  Hobbesian  'war  of  all  against  all'  (Hobbes,  1651].  As 
already  alluded  to,  a  rich  history  of  customary  international  law  has  been  gradually  built  up  and 
accepted  by  warring  parties  through  the  ages,  and  international  institutions  have  gradually  come  to 
exist  which  can  enforce  them.  Throughout  history,  as  a  matter  of  honor,  prudence,  strategic 
foresight,  or  even  mercy,  there  have  been  jus  in  bello  restrictions  that  acquired  both  moral  and  legal 
weight. 

This  trend  toward  seeing  war  as  an  activity  with  rules  or  virtues  that  sanction  proper  and  improper 
behavior  has  only  gained  strength  as  states  have  acquired  an  institutional  professional  military, 
especially  one  independent  of  those  making  jus  ad  bellum  decisions.  This  is  the  case  even  when  such 
professional  militaries  are  voluntarily  joined,  for  most  if  not  all  of  the  individual  soldiers  no  longer 
have  a  meaningful  right  to  refuse  to  fight  wars  that  they  find  morally  objectionable,  nor  do  they  have 
the  moral  right  to  fight  wars  in  any  way  they  see  fit.  Instead,  professional  soldiers  have  a  code  of 
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conduct  that  details  their  proper  and  improper  functioning  in  their  various  roles,  just  as  other 
professions  do.  They  cannot  be  meaningfully  held  responsible  for  decisions  by  politicians  over  which 
they  have  no  control;  but  they  can  be  held  responsible  for  performing  their  roles  in  war  in  a  way  the 
international  community  recognizes  as  legitimate  and  avoiding  illegitimate  means  of  performing 
those  roles. 

As  a  result,  and  despite  (or  because  of)  the  movement  toward  total  war  in  World  War  2  through 
indiscriminate  weapons  of  mass  destruction,  arguments  for  total  war  doctrine  now  have  a  sense  of 
the  ridiculous.  The  Geneva  and  Hague  Conventions  have  delineated  various  jus  ad  bellum 
restrictions  on  war  ever  since  1864,  with  major  protocols  added  in  1977  and  amendments  continuing 
to  be  debated  and  accepted  up  to  the  present.  The  international  community  and  international  law 
have  thus  come  to  a  widespread  consensus  that  total  war  is  immoral  and  cannot  possibly  be 
justified.  While  morally  waging  war  does  legitimate  the  killing  of  those  who  are  waging  war  for  the 
enemy,  it  does  not  legitimate  mass  murder  (unjustified  killing)  of  non-combatants,  or  worse;  and 
there  are  indeed  worse  things  than  death.  War  is  now  both  too  dangerous  and  too  professionalized 
to  be  fought  so  cavalierly,  without  rules  or  restrictions. 

4.4.2  Traditional  Jus  in  Bello 

Total  war  is  thus  morally  unacceptable;  there  must  be  jus  in  bello  restrictions  for  a  war  to  be  morally 
fought,  which  reflect  the  virtues  of  a  morally-just  warrior.  Such  a  'warrior  ethos'  [Oh,  2008]  is  widely 
accepted  among  the  professional  military.  Just-war  theory  thus  demands  a  'Jundomentol  moral 
consistency  between  means  and  ends  with  regard  to  wartime  behavior"  [Orend,  2006,  p.  105].  As 
just  wars  are  limited  wars,  not  total  wars,  there  will  be  restraints  on  the  means  of  permissible 
wartime  coercion.  And  as  robots  themselves  will  not  be  declaring  war  for  the  foreseeable  future,  the 
direct  relevance  of  just-war  theory  for  autonomous  military  robots  will  deal  with  how  they  would 
conduct  themselves  in  prosecuting  military  activities— and  so  the  relevant  issue  is  jus  in  bello,  divided 
into  external  rules  (how  a  state's  military  treats  its  enemies)  and  internal  rules  (how  a  state's  military 
treats  its  own  people). 

Much  of  the  just-war  tradition  [e.g.,  O'Brien,  1981]  asserts  only  two  basic  necessary  conditions  for 
the  external  rules  of  jus  in  bello: 

1.  Proportionality.  Again,  the  military  ends  must  be  proportionate  to  the  means:  no 
unnecessary  violence  is  to  be  used  in  order  to  attain  one's  military  goal,  but  only  a  level  of 
force  proportionate  to  attaining  one's  goal.  To  drive  the  enemy  from  a  hillside,  artillery 
shells  may  be  used;  a  nuclear  weapon  that  obliterates  the  hillside  and  all  other  life  within 
100  square  kilometers  must  not  be  used,  as  it  would  be  wildly  disproportionate.  Robots 
would  need  to  learn  how  to  apply  force  proportionate  to  their  goal,  using  some  operational 
program  that  involved  properly  computing  the  minimal  force  necessary  for  military  success, 
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i.e.,  using  the  accepted  military  criteria  of  'military  necessity.'  After  testing,  it  is  easy  to 
imagine  that  robots  could  perform  at  least  as  well  as  humans  In  deploying  no  greater  violent 
force  than  needed,  and  thereby  passing  the  'military  Turing  test'  for  moral  deployment. 

Under  proportionality,  Walzer  and  others  also  include  other  aspects  of  traditional  jus  in  bello 
that  reject  any  means  'mala  in  se'— that  is,  evil  in  themselves— because  they  violate  human 
rights  whenever  used,  such  as  rape  [Orend,  2001,  p.  124].  Robots  presumably  can  be  easily 
programmed  to  avoid  such  means.  Proportionality  also  informs  the  moral  treatment  of 
POWs,  such  as  'benevolent  quarantine':  POWs  may  be  stripped  of  weapons,  isolated  from 
fighting,  and  questioned;  but  there  remains  the  moral  requirement  not  to  torture,  beat, 
starve,  or  medically  experiment  upon  POWs,  as  agreed  upon  in  the  Hague  and  Geneva 
Conventions.  Whether  or  not  all  such  protections  apply  to  'enemy  combatants'  in  the  so- 
called  'War  on  Terror'  Is  a  matter  of  political  discussion;  in  any  case,  even  the  current  US 
administration  does  not  suggest  that  there  are  no  restrictions  on  the  treatment  of  'enemy 
combatant'  prisoners.  Whatever  the  Laws  of  War  amount  to  in  these  cases,  programming 
robots  to  obey  them  poses  no  special  problems  over  and  above  the  basic  problem  of  robot 
discrimination  and  classification  of  humans  into  their  proper  jus  in  bello  categories,  and  then 
meting  out  the  appropriate  treatment.  Thus,  we  see  the  next  requirement  may  be  trickier 
for  robots. 

2.  Discrimination  and  non-combatant  immunity.  One  must  attempt  to  discriminate  between 
combatants  and  noncombatants  (civilians),  and  noncombatants  must  not  be  intentionally 
killed.  By  engaging  in  warfare,  enemy  soldiers  become  legitimate  targets  of  lethal  force  in 
order  to  coerce  their  surrender  and  thus  end  their  resistance  to  your  victory;  but  those  who 
are  not  combatants  do  not  forcibly  oppose  one's  goals  in  war  and  do  not  impede  victory 
directly.  Hence,  as  they  need  not  be  forcibly  coerced  In  order  to  attain  victory,  it  is  immoral 
to  do  so.  In  short.  If  someone  Is  not  directly  engaged  in  intentionally  harming  you.  It  is 
morally  Impermissible  to  intentionally  harm  them,  sometimes  termed  the  'principle  of  self- 
defense.'  Hence,  we  can  see  that  jus  in  bello  prohibits  weapons  that  are  Intrinsically 
disproportionate,  such  as  thermonuclear  weapons  in  conventional  wars,  or  those  that  fail  to 
discriminate  between  combatants  and  civilians,  such  as  most  biological  or  chemical 
weapons— and  perhaps  even  many  modes  of  'cyberattacks'  on  computer  networks  (Rowe, 
2008]. 
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4.43  The  Doctrine  of  the  Double  Effect  (DDE) 

We  should  note  well  that  the  requirement  of  civilian  immunity  is  merely  that  noncombatants  must 
not  be  intentionally  killed  or  harmed,  not  that  they  must  not  be  harmed  at  all.  The  latter 
requirement  in  practice  would  lead  directly  to  pacifism,  as  no  war  yet  fought  or  practically  imagined 
could  guarantee  a  complete  absence  of  civilian  casualties.  But  if  noncombatants  can  never  be 
legitimate  targets,  how  can  it  be  morally  legitimate  to  harm  and  even  kill  them?  The  usual  way  out 
of  this  problem  of  'collateral  damage'—that  in  practice,  all  those  who  wage  war  foresee  that  some 
noncombatants  will  inevitably  be  harmed—is  to  use  a  time-honored  ethical  principle  (originating 
from  natural  law  ethics)  called  the  Doctrine  of  the  Double  Effect  (DDE)  that  Is  a  central  principle  in 
both  the  LOW  and  the  specific  ROE  that  the  military  specifies  for  each  mission,  as  defined: 

Doctrine  of  the  Double  Effect,  In  the  DDE,  an  action  may  be  morally  permissible,  even  if  it  is 
foreseen  that  it  will  cause  a  bad  effect,  if  certain  conditions  are  met  [McIntyre,  2004]: 

a.  The  act  itself  is  not  morally  wrong  (e.g.,  killing  combatants  in  wartime); 

b.  The  good  effect  is  produced  directly  by  the  action,  and  not  by  the  bad  effect  (e.g.,  winning  is 
produced  by  killing  of  the  enemy  combatants,  not  by  terrorizing  or  murdering  civilians;  the 
use  of  nuclear  weapons  or  widespread  chemical/  biological  dispersal  (as  In  terrorism)  fail 
this  criterion); 

c.  The  good  effect  is  sufficiently  desirable  to  compensate  for  allowing  the  bad  effect  (winning 
is  worth  killing  civilians);  and, 

d.  The  bad  effect  must  not  be  intended,  but  merely  foreseen  and  permitted  (e.g.,  we  would  be 
happy  if  all  Iraqi  civilians  escape,  but  alas,  one  foresees  they  all  will  not,  and  our  weapons 
never  Intentionally  target  them). 

According  to  the  DDE,  one  can  kill  noncombatants  only  if  the  intention  of  the  actor  Is  good,  that  Is, 
his  or  her  aim  is  narrowly  at  the  intended  effect;  the  'evil'  effect  Is  not  the  goal,  nor  a  means  to  the 
goal;  and  the  warrior  seeks  to  minimize  evil  involved,  making  any  evil  unintentional.  That  is,  one  can 
engage  in  military  actions  that  one  foresees  will  result  in  an  evil  consequence  (such  as  harming 
noncombatants)  as  long  as  that  harm  was  not  intended  and  one  attempts,  as  best  as  one  can,  to 
minimize  the  unintended  harmful  consequences.  'Military  necessity'  thus  permits  collateral  damage, 
as  long  as  It  was  either  unforeseen,  or  foreseen  but  unintended  and  necessary  to  the  attainment  of 
the  military  goal  or  objective.  As  a  more  difficult  application  of  the  DDE,  consider  the  following:  May 
we  morally  target  the  opposition's  military  bases?  On  one  hand.  It  seems  not,  since  noncombatants 
work  there  (e.g.,  doctors,  cooks,  janitors);  but  by  the  DDE,  it  may  be  permissible,  as  long  as  the 
noncombatants  are  not  targeted.  Therefore,  we  should  not  attack  non-combatant  sleeping  quarters 
and  perhaps  time  our  attack  during  a  period  In  which  a  minimum  number  of  non-combatants  occupy 
the  site  (e.g.,  late  at  night),  making  any  resulting  non-combatant  deaths  the  accidental  casualties  of 
taking  out  one's  intended  military  (combatant)  target. 
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4.4.4  The  Principle  of  the  Double  Intention  (PDI) 

Walzer  and  nnany  others  in  the  just-war  tradition  are  also  focused  on  clarifying  the  DDE  so  to  make 
clear  that  it  is  illegitimate  in  a  just  war  to  intend  harm  to  noncombatants,  Arkin  [2007]  thus 
appropriates  an  aspect  of  Walzer's  work  in  his  work  on  devising  methods  of  programming  ethical 
autonomous  robots,  and  in  particular  endorses  Walzer's  version  of  the  DDE:  the  Principle  of  the 
Double  Intention  (PDI)  which  is  essentially  the  DDE  plus  a  further  ('double')  intention  that 
combatants  are  not  only  to  refrain  from  intending  harm  to  civilians,  but  they  are  also  to  take 
precautions  to  reduce  risk  to  civilians,  even  at  the  expense  of  increasing  risk  to  themselves. 

Immediate  questions  for  ethics  are  raised  by  the  PDI:  For  example,  what  does  it  mean  to  intend  to 
reduce  civilian  risk,  and  how  much  should  civilian  risk  be  reduced  [Lee,  2004]?  For  instance,  in  the 
technologically-asymmetric  warfare  typical  of  America's  military  actions  in  Iraq  and  Afghanistan,  are 
long-range  precision-guided  munitions,  which  allow  accurate  targeting  to  within  a  few  feet,  morally 
allowed  by  the  principle  of  discrimination— or  are  soldiers  morally  obliged  to  engage  in  close 
quarters  combat  (at  far  greater  personal  risk)  in  order  to  further  minimize  the  possibility  of  civilian 
harm?  Walzer's  PDI  gives  no  clear  answer,  unfortunately.  The  principle  Walzer  appeals  to  is  one 
from  liability  law— the  'principle  of  due  care'— that  is,  that  one  exercised  due  care  (including 
potentially  creating  some  risk  to  oneself)  before  targeting  the  enemy,  and  hence  did  not  heedlessly 
attack  civilians.  An  example  would  be  requiring  soldiers  to  move  in  closer  to  a  target  to  ensure  they 
hit  it  and  not  nearby  civilians,  even  at  some  risk  to  themselves.  But  how  close  is  morally  mandated? 
And  what  of  bombers  flying  sorties  with  'smart'  weapons,  who  can  fly  higher  and  farther  away  (and 
hence  more  safely)  and  still  hit  their  targets  reliably— but  how  reliably?  What  level  of  reliability  and 
accuracy  constitutes  'due  care'?  (We  will  discuss  liability  law  further  in  the  next  section  of  this 
report.) 

What  is  clear  is  that  Walzer  argues  that  even  in  war,  moral  agents  must  minimize  the  foreseen  harm 
(to  the  undeserving),  even  if  this  will  involve  accepting  additional  risk  or  foregoing  some  benefit.  The 
potential  breakthrough  that  robots  present  here  is  trumpeted  by  Arkin,  who  believes  it  is  possible  to 
create  robots  that  will  do  better  than  human  soldiers  at  satisfying  Walzer's  additional  condition  in 
the  PDI— which  is  especially  difficult  for  humans  who  understandably  are  reluctant  to  minimize 
foreseen  harm  to  others  at  the  cost  of  a  greater  risk  to  their  own  life,  but  this  should  be  easier  for 
literally  selfless  robots  who  do  not  prioritize  their  own  continued  existence  over  obeying  their  ethical 
programming. 

For  current  tele-operated  military  robots,  such  as  the  Predator  UAV,  the  current  understanding  of 
the  requirement  of  discrimination  involves  the  need  for  'eyes  on  target':  the  weapon  cannot  fire 
until  and  unless  the  human  tele-operator  has  the  target  firmly  acquired  in  its  sights,  and  no  civilians 
are  in  the  bullseye.  But  the  time  lag  between  remotely  pulling  the  trigger  and  the  weapon  actually 
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firing,  along  with  all  the  vulnerabilities  in  the  electromechanical  connections  in  between,  mean  that 
eventually  a  robot  with  real-time  decision-making  capability— a  sufficiently  autonomous  robot- 
should  be  able  to  do  as  well  or  better  than  a  human  operator  in  such  discrimination.  Closer  to  the 
target,  the  robot  likely  would  be  more  effective  in  preventing  unintended  deaths.  At  that  point,  it 
seems  jus  in  bello  would  permit  or  even  demand  that  such  autonomous  robots  be  used,  and  the 
requirement  of  human  eyes  on  target— i.e.,  that  robots  be  tele-operated— would  be  morally 
scrapped,  as  the  best  means  of  employing  the  principle  of  discriminating  between  combatant  and 
non-combatant  targets  can  then  be  done  by  a  machine.  We  already  accept  that,  due  to  gravitational 
forces,  computers  can  fly  in  situations  that  humans  cannot;  it  is  plausible  they  will  soon  make  better 
and  more  moral  targeting  decisions  as  well. 


4.5  Rules  of  Engagement  and  the  Laws  of  War 


The  Rules  of  Engagement  comprise  directives  issued  by  competent  military  authorities  that  delineate 
both  the  circumstances  and  the  restraints  under  which  combat  with  opposing  forces  is  joined.  For 
robots,  the  specific  ROE  for  each  mission  will  have  to  be  programmed  in  (which  may  raise  technical 
issues),  but  there  are  no  special  ethical  concerns  with  the  ROE,  as  long  as  they  do  not  violate  the 
already  extant  jus  in  bello  restrictions  of  the  LOW.  Hence,  the  ROE  would  constitute  an  additional 
ethical  issue  for  the  morality  of  deploying  military  robots  only  If  the  competent  military  authorities 
were  to  program  in  a  ROE  that  violated  the  underlying  LOW.  While  certainly  possible,  this  raises  no 
culpability  issues  that  do  not  already  exist  with  human  soldiers.  For  instance,  a  'loosened'  ROE  that 
permits  cross-border  attacks  into  sovereign  nations  with  which  we  are  not  formally  at  war,  in  cases 
where  our  troops  witness  attacks  originating  from  the  region  and  even  if  those  attacks  are  not 
directed  at  us,  arguably  violates  the  LOW,  specifically  the  self-defense  requirement. 

If  this  or  any  other  ROE  does  violate  the  LOW,  the  ethical  result  of  using  robots  may  be  a  moral 
improvement,  since  robots  properly  programmed  to  never  violate  the  LOW  would  refuse  to  follow 
immoral  orders,  unlike  human  soldiers  who  are  trained  to  unfailingly  follow  all  orders.  With  robots, 
we  may  be  better  positioned  to  ensure  compliance  with  the  jus  In  bello  aspects  of  the  LOW,  which  Is 
a  substantial  argument  in  favor  of  deploying  such  robots.  (We  return  to  the  issue  of  a  robot 
disobeying  an  order  in  section  7.) 


4.6  Just-War  Theory:  Jus  post  Bellum 


President  George  W.  Bush  declared  the  end  of  major  combat  operations  for  coalition  forces  in  Iraq 
only  a  couple  of  months  after  hostilities  began;  yet  the  insurgency  ever  since  has  caused  far  more 
casualties  than  the  actual  war  against  the  Iraqi  government  ever  did.  It  thus  seems  that  robots,  with 
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suitable  jus  post  helium  programming,  could  also  serve  as  peacekeepers  without  either  the  casualties 
or  tendency  to  target  civilians  that  are  among  the  problems  of  using  human  troops  in  peacekeeping 
roles.  But  one  objection  to  robot  peacekeepers  Is  that  having  machines  occupy  some  city  or  patrol 
the  .streets  won't  help  win  the  hearts  and  minds  of  the  occupied  or  vanquished.  Could  robots  be  so 
off-putting,  so  overwhelming  or  offensive,  that  they  make  lasting  peace  more  difficult  to  achieve? 

This  will  again  be  a  concern  that  we  return  to  in  section  7  of  this  report,  but  one  may  initially  and 
reasonably  expect  that,  as  local  populations  gain  experience  with  robot  peacekeeping  that  routinely 
performs  in  a  morally  equivalent  or  superior  way  to  human  peacekeeping,  their  worries  will  soon 
ease.  After  all,  robots  presumably  will  not  be  raping,  pillaging,  degrading,  taunting,  or  stealing  food 
from  the  local  population,  as  might  occur  with  human  peacekeepers  fueled  by  adrenaline,  emotions, 
and  perhaps  hatred.  And  improvements  in  the  appearance  of  robot  peacekeepers  may  also  do  much 
to  assuage  this  worry;  just  as  robotic  lethal  weaponry  is  often  made  to  look  fearsome  in  order  to 
strike  terror  into  enemy  forces,  robotic  peacekeepers  could  be  designed  to  appear  friendly  and  non¬ 
threatening. 


4.7  First  Conclusions:  Relevance  to  Robots 


In  the  not-too-distant  future,  relatively  autonomous  robots  may  be  capable  of  conducting  warfare  in 
a  way  that  matches  or  exceeds  the  traditional  jus  in  hello  morality  of  a  human  soldier.  With  a 
properly  programmed  slave  morality,  a  robot  can  ensure  It  will  not  violate  the  LOW  or  ROE,  and  it 
can  even  become  a  superior  peacekeeper  after  official  hostilities  have  ceased.  And  of  course,  having 
robots  fight  for  us  promises  to  dramatically  reduce  casualties  on  our  side  and  may  become  a 
fearsome  enough  weapon  that  eventually  war  will  cease  to  be  a  desirable  option  by  nation-states  as 
a  means  of  resolving  their  differences.  Once  such  robots  exist  and  have  been  properly  trained 
through  simulations,  there  will  be  little  moral  justification  to  keep  them  sidelined:  if  war  is  to  be 
fought,  we  will  have  good  moral  reason  to  have  the  robots  do  the  fighting  for  us. 

In  the  meantime,  there  are  still  a  number  of  concerns  to  address  related  to  risk,  ethics,  and  technical 
challenges.  In  the  next  sections,  we  will  continue  a  discussion  on  legal  liability  and  responsibility,  as 
well  as  a  broader  discussion  about  technology  risk  assessment  in  military  robotics. 
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5.  Law  and  Responsibility 


The  use  of  robots,  particular  military  robots  with  the  capacity  to  deliberately  do  harm  and  which 
have  increasing  degrees  of  autonomy,  naturally  raises  issues  with  respect  to  established  law  and 
liability.  Assuming  we  can  program  morality  into  robots  in  the  first  place,  using  military  law— i.e., 
Rules  of  Engagement— as  a  behavioral  framework  seems  to  be  reasonable  or  at  least  more 
manageable  than  attempting  to  program  in  the  much  larger  set  of  society's  civil  and  criminal  laws. 
But  what  would  happen  if  a  robot  commits  some  act  outside  the  bounds  of  its  programming— who 
then  becomes  responsible  for  that  action? 

The  answer  perhaps  depend  on  the  cause,  whether  the  act  results  from  a  programming  error  or 
malfunction  or  accident  or  intentional  misuse.  But  in  any  case,  we  would  be  hard-pressed  to  assign 
blame  today  to  our  machines;  yet  as  robots  become  more  autonomous,  a  case  could  be  made  to 
treat  robots  as  culpable  legal  agents.  This  section  investigates  several  issues  related  to  legal 
responsibility  and  robots,  both  current  and  future.^ 


5.1  Robots  as  Legal  Quasi-Agents 


How  might  the  law  treat  robots  as  potential  legal  agents?  There  are  several  relevant  aspects  of  the 
law  that  might  bear  upon  robots,  and  we  will  consider  each  in  turn,  after  a  brief  overview.  In  the 
most  straightforward  sense,  the  law  has  a  highly  developed  set  of  cases  and  principles  that  apply  to 
product  liability,  and  we  can  apply  these  to  the  treatment  of  robots  as  commercial  products.  As 
robots  begin  to  approach  more  sophisticated  human-like  performances,  it  seems  likely  that  they 
might  be  treated  as  quosi-agents  or  quasi-persons  by  the  law,  enjoying  only  partial  rights  and  duties, 

A  closely  related  concept  is  that  of  diminished  responsibility,  in  which  agents  are  considered  as  being 
not  fully  responsible  for  their  own  actions.  This  will  bring  us  to  the  more  abstract  concept  of  agency 
itself  in  the  law,  and  how  responsibility  is  transferred  to  different  agents.  Finally,  we  will  consider 
corporate  punishment,  which  is  relevant  both  as  it  applies  to  cases  of  wrongdoing  in  product  liability, 
but  also  because  it  addresses  the  problem  of  legal  punishments  aimed  at  non-human  agents,  namely 
corporations. 


^  We  thank  and  credit  Peter  Asaro  for  his  contribution  to  the  discussion  here. 
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5.1.1  Responsibility  ond  Liobility:  Robots  os  Products 

In  the  system  of  Anglo-American  law,  a  distinction  is  drawn  between  criminal  and  civil  law.  Civil  law 
is  traditionally  called  tort  law  and  deals  primarily  with  property  rights  and  infringements,  such  as 
damage  to  property  or  other  harms,  and  seeks  justice  by  compelling  wrongdoers  to  compensate 
those  who  were  harmed  for  their  loss.  Criminal  law  deals  with  what  we  often  think  of  as  moral 
wrongdoing,  stealing,  murder,  etc.,  and  seeks  justice  by  punishing  the  wrongdoer.  The  difference  is 
that  between  someone  building  a  toy  robot  which  shoots  little  plastic  missiles  that  causes  several 
small  children  to  choke  to  death,  and  someone  who  builds  a  robot  with  a  built-in  bomb  that  kills  a 
nurrber  of  people  on  a  public  street.  In  each  case  there  is  a  robot  causing  death,  but  in  the  first  case 
the  parents  of  the  children  would  file  a  lawsuit  against  the  manufacturer  seeking  monetary 
compensation,  and  In  the  second  case  the  government  would  find,  arrest,  prosecute  and  punish  the 
individuals  responsible.  Let  us  set  criminal  law  aside  for  the  moment,  however,  as  civil  law  appears 
more  relevant  to  robots  as  they  now  exist,  insofar  as  they  might  be  capable  of  material  wrongdoing. 

Even  if  we  make  no  assumptions  about  the  intentions,  consciousness,  or  moral  agency  of  robots,  we 
can  still  apply  the  basics  of  civil  law  to  robots  as  they  now  exist.  That  is,  we  can  assume  that  robots 
are  completely  unremarkable  technological  artifacts,  no  different  than  toasters  or  cars,  and  there  are 
still  legal  and  moral  issues  connected  with  their  production  and  use.  In  fact,  the  companies  that 
currently  manufacture  robots,  such  as  the  Furby^"^  and  AIBO^“,  can  be  held  accountable  under  these 
laws,  and  therefore  almost  certainly  employ  and  retain  lawyers  who  are  paid  to  advise  them  on  their 
legal  responsibilities  in  producing,  advertising,  and  selling  these  robots  to  the  general  public. 
Furthermore,  it  seems  that  many  of  the  concerns  about  the  possible  harms  that  robots  might  cause 
would  ultimately  fall  under  this  mundane  Interpretation.  While  these  may  not  be  the  most 
philosophically-challenging  issues  regarding  robot  ethics,  they  seem  likely  to  be  the  most  common. 

5.1.2  Stondords  of  Liobility 

The  relevant  legal  concept  in  cases  like  our  toy  robot  that  chokes  small  children  Is  negligence. 
Neg  igence  implies  that  the  manufacturer  failed  to  do  something  that  was  morally  or  legally 
required,  and  thus  they  can  be  held  responsible  for  certain  harms  produced  by  their  product— in 
legal  terminology  this  is  called  reasonoble  core.  Legally  culpable  forms  of  negligence  in  product 
liability  cases  depend  upon  either /o/7ures  to  warn,  or  failures  to  toke  proper  core.  Afoilure  to  worn 
occurs  when  the  manufacturer  was  knowingly  aware  of  a  risk  or  danger  but  failed  to  notify 
consumers  of  this  risk.  This  Is  the  reason  why  there  are  now  so  many  warning  labels  on  various 
products,  and  in  the  example  above  the  manufacturer  might  avoid  liability  by  putting  a  label  on  the 
package  stating  that  the  robot  contains  parts  that  are  a  choking  hazard  to  young  children.  A  failure 
to  take  proper  core  or  ovoid  foreseeoble  risks  is  more  difficult  to  prove  in  court  because  it  is  more 
abstract,  and  Involves  cases  where  the  manufacturer  cannot  be  shown  to  have  known  about  a  risk  or 
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danger  from  the  product.  In  these  cases,  it  is  argued  that  the  given  danger  or  risk  was  in  some  sense 
obvious  or  easily  foreseeable,  even  if  the  manufacturer  failed  to  recognize  it.  In  order  to  prove  this, 
the  plaintiff's  lawyers  often  bring  in  experts  to  testify  that  those  risks  were  obvious,  and  so  forth. 

Another  interesting  aspect  of  liability  is  that  it  can  be  differentially  apportioned.  That  is  to  say,  for 
example,  one  party  might  be  10%  responsible,  while  another  is  90%  responsible  for  some  harmful 
event.  This  kind  of  analysis  of  the  causal  chains  resulting  in  harms  is  not  uncommon,  especially  in 
traffic  accidents  and  product  liability  cases.  In  many  jurisdictions  there  are  laws  imposing  joint  and 
several  liability,  which  holds  all  parties  equally  responsible  for  compensation,  even  if  they  are  not 
equally  responsible  for  the  harm.  Nonetheless,  these  cases  still  recognize  that  various  factors  and 
parties  contribute  differentially  to  some  event. 

Differential  apportionment  could  be  a  useful  tool  when  considering  issues  in  robot  ethics.  For 
instance,  a  badly-designed  object  recognition  algorithm  might  be  responsible  for  some  damage 
caused  by  a  robot,  but  a  bad  camera  could  also  contribute,  as  could  a  weak  battery,  or  a 
malfunctioning  actuator,  and  so  on.  This  implies  that  engineers  need  to  think  carefully  about  how 
the  subsystem  they  are  working  on  could  interact  with  other  subsystems— whether  as  designed  or  in 
unintentional  partial  breakdown  situations— in  potentially  harmful  ways. 

Further,  the  context  in  which  the  robot  has  been  placed,  such  as  the  instructions  given  by  its  owners, 
may  also  be  the  principle,  or  contributing,  cause  of  some  harm  in  which  a  robot  is  the  proximate 
cause.  In  short,  there  is  a  limit  to  what  robot  engineers  and  designers  can  do  to  limit  the  potential 
uses  and  harms  caused  by  their  products,  because  other  parties  (i.e.,  the  consumers  and  users  of 
robots)  will  choose  to  do  all  sorts  of  things  with  such  products  and  will  have  to  assume  the 
responsibility  for  those  choices.  Similarly,  there  will  always  be  risks  Inherent  in  the  use  of  robots, 
and  at  some  point  the  users  may  be  judged  by  a  court  to  have  knowingly  assumed  these  risks  in  the 
very  act  of  choosing  to  use  a  robot. 

The  potential  failure  to  take  proper  core,  and  the  reciprocal  responsibility  to  take  proper  care,  is 
perhaps  the  central  issue  in  practical  robot  ethics.  What  constitutes  proper  care,  and  what  risks 
might  be  foreseeable,  or  in  principle  unforeseeable,  is  a  deep  and  vexing  problem.  This  is  due  to  the 
inherent  complexity  of  potential  future  interactions  and  the  relative  autonomy  of  the  product  once  it 
is  produced.  Sophisticated  robots  that  will  be  capable  of  interacting  with  people  and  the  world  in 
highly  complex  ways,  and  that  may  develop  and  learn  new  ways  of  acting  which  extend  beyond  their 
intended  design,  present  a  difficult  future  in  which  to  foresee  risks.  Robot  ethics  shares  this  double- 
edged  problem  with  the  bio-engineering  ethics— both  the  difficulty  In  predicting  the  future 
interactions  of  a  product  when  the  full  scope  of  possible  interactions  can  at  best  only  be  estimated, 
and  in  producing  a  product  that  is  an  intrinsically  dynamic  and  evolving  system  whose  behavior  may 
not  be  easily  guided  after  it  has  been  produced. 
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The  classic  defense  against  charges  of  failures  to  warn  and  failures  to  take  proper  care  is  the  industry 
standard  defense.  The  basic  argument  of  the  industry  standard  defense  is  that  the  manufacturer 
acted  in  accordance  with  the  stated  or  unstated  standards  of  their  industry.  Thus,  they  were  merely 
doing  what  other  similar  manufacturers  were  doing  and,  in  doing  so,  taking  proper  care  as  measured 
against  their  peers.  This  need  for  a  relative  measure  again  points  to  the  vagueness  of  the  concept  of 
proper  care,  and  the  inherent  difficulty  of  determining  what  specific  and  practical  legal  and  moral 
duties  follow  from  the  obligation  to  take  proper  care.  This  kind  of  defense  also  fails  to  tell  us  what 
sorts  of  practices  should  be  followed  in  the  design  of  robots.  That  is,  robot  ethics  should  be 
concerned  with  the  establishment  of  standards  for  the  robot  industry  which  will  ensure  that  the 
relevant  forms  of  proper  care  are  taken.  It  seems  that  this  ought  to  be  one  of  the  industry's  top 
objectives  for  future  research,  and  there  is  quite  a  bit  more  to  be  said  about  this  issue;  but  for  now 
we  will  stay  with  the  law  in  our  discussion. 


5.2  Agents,  Quasi-Agents,  and  Diminished  Responsibility 


The  law  offers  several  ways  of  thinking  about  the  distribution  of  responsibility  in  complex  cases.  As 
we  saw  in  the  previous  section,  responsibility  for  a  single  event  can  be  divided  amongst  several 
parties,  and  each  party  can  even  be  given  a  quantitative  share  of  the  total  responsibility.  We  will 
now  consider  how  even  a  single  party's  responsibility  can  be  divided  and  distributed.  Modern  legal 
systems  were  established  on  the  presupposition  that  all  legal  entities  are  persons.  While  a  robot 
might  someday  be  considered  a  person,  we  are  not  likely  to  face  this  situation  any  time  soon. 
However,  the  law  has  also  been  designed  to  deal  with  several  kinds  of  non-persons,  or  quasi- 
persons,  and  we  can  look  to  these  for  some  insights  on  how  we  might  treat  robots  that  are  non¬ 
persons,  or  quasi-persons. 

Personhood  is  a  hotly  debated  concept,  and  many  perspectives  in  that  debate  are  based  in  strongly 
held  beliefs  from  religious  faith  and  philosophical  dispositions.  Most  notably,  the  case  of  unborn 
human  fetuses,  and  the  case  of  severely  brain  damaged  and  comatose  individuals  have  led  to  much 
debate  in  the  United  States  over  their  appropriate  legal  status  and  rights.  Yet,  despite  strongly 
differing  perspectives  on  such  issues,  the  legal  systems  in  pluralistic  societies  have  found  ways  to 
deal  practically  with  these  and  several  other  border-line  cases  of  personhood. 

Minor  children  (under  18  years  of  age)  are  a  prime  example  of  quasi-persons.  Minors  do  not  enjoy 
the  full  rights  of  personhood  that  adults  do.  In  particular,  they  cannot  sign  contracts  or  become 
involved  in  various  sorts  of  legal  arrangements  because  they  do  not  have  the  right  to  do  so  as 
minors.  They  can  become  involved  in  such  arrangements  only  through  the  actions  of  their  parents  or 
legal  guardians.  In  this  sense  they  are  not  full  legal  persons.  In  another  sense,  the  killing  of  a  child  is 
murder  in  the  same  way  that  the  killing  of  an  adult  is,  and  so  a  child  is  still  a  legal  person  in  this 
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sense— and  in  fact  is  entitled  to  many  more  protections  than  an  adult.  Children  can  thus  be 
considered  a  type  of  quasi-person,  or  legal  quasi-agent. 

The  case  of  permanently  mentally-impaired  people  can  be  quite  similar  to  children.  Even  fully- 
fledged  persons  can  claim  temporary  impairments  of  judgment,  and  thereby  diminished 
responsibility  for  their  actions  given  certain  circumstances,  e.g.,  temporary  insanity  or  being 
involuntarily  drugged.  The  point  is  that  some  aspects  of  legal  agency  can  apply  to  entities  which  fall 
short  of  full-fledged  personhood  and  having  full  responsibility,  and  it  seems  reasonable  to  think  that 
some  robots  will  eventually  become  a  kind  of  quasi-agent  in  the  view  of  the  law  before  they  achieve 
full  legal  personhood. 

The  concept  of  personhood  is  deeply  tied  to  the  notion  of  agency.  The  law  also  deals  explicitly  with 
agency  and,  interestingly  enough.  It  does  so  in  order  to  address  cases  in  which  the  power  of  agency 
is  transferred  between  parties.  The  law  of  agency  Is  a  highly  specialized  field  that  deals  mainly  with 
the  talent  agents  of  athletes  and  entertainers,  and  to  some  extent  Insurance,  travel,  and  real  estate 
agents.  These  agents  are  empowered  by  their  employers,  whom  they  thereby  represent  for  the 
purpose  of  negotiating  contracts  and  making  various  agreements  on  their  behalf.  An  individual  is 
bound  by  the  contracts  that  their  agent  signs  just  as  if  they  had  signed  the  contracts  themselves, 
except  in  cases  where  one  can  prove  misconduct  on  the  part  of  the  agent.  To  act  as  someone's 
agent  is  to  enact  their  legal  powers  from  afar,  and  is  in  this  sense  a  form  of  distribution  of  legal 
agency. 

The  possible  application  to  robotics,  especially  tele-robotics,  seems  Inviting— robots  could  be  seen  in 
many  cases  as  agents  acting  on  the  behalf  of  others.  Accordingly,  the  legal  responsibility  for  the 
actions  of  a  robot  falls  on  the  individual  who  grants  the  robot  permission  to  act  on  their  behalf.  If  it 
is  not  already  clearly  enough  implied  by  the  law.  It  might  be  advisable  to  make  a  law  which  makes 
such  legal  responsibilities  explicit.  Such  a  law  would  need  to  be  carefully  crafted,  however,  to  avoid 
placing  too  heavy  a  burden  on  the  owners  of  robots,  preventing  the  adoption  of  robots  due  to  risk, 
and  to  avoid  unfairly  protecting  manufacturers  who  might  share  in  the  responsibility  of  misbehaving 
robots  due  to  poor  designs. 


5.3  Crime,  Punishment,  and  Personhood 


Crime  and  punishment  are  central  concepts  in  both  law  and  morality,  yet  they  might  seem  out  of 
place  in  a  discussion  of  robot  ethics.  While  we  can  imagine  a  humanoid  robot  of  such  sophistication 
that  it  is  effectively,  or  Indlstinguishably,  a  person,  these  robots  will  be  easier  to  find  in  science 
fiction  than  in  reality  for  a  long  time  to  come.  There  are,  however,  technologically-possible  robots 
that  may  approach  actions  that  we  might  consider,  at  least  at  first  glance,  to  be  criminal.  If  so,  how 
might  the  law  instruct  us  to  treat  such  cases? 
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As  stated  earlier,  criminal  law  is  concerned  with  punishing  wrongdoers,  whereas  civil  law  is  primarily 
concerned  with  compelling  wrongdoers  to  compensate  those  harmed.  There  is  an  important 
principle  underlying  this  distinction:  crimes  deserve  to  be  punished,  regardless  of  any  compensation 
to  those  directly  harmed  by  the  crime.  Put  another  way,  the  harmed  party  In  a  crime  is  the  whole  of 
society.  Thus,  the  case  is  prosecuted  by  the  state  or  'the  people',  and  the  debt  owed  by  the 
wrongdoer  is  owed  to  the  society.  While  the  punishments  may  take  different  forms,  the  point  of 
punishment  is  traditionally  conceived  of  as  being  corrective  in  one  or  more  senses:  that  the 
wrongdoer  pays  their  debt  to  society  (retribution);  that  the  wrongdoer  is  to  be  reformed  so  as  not  to 
repeat  the  offense  (reform);  or  that  other  people  in  society  will  be  dissuaded  from  committing  a 
similar  wrong  (deterrence). 

There  are  two  key  problems  with  applying  criminal  law  to  robots:  (1)  criminal  actions  require  a  moral 
agent  to  perform  them,  and  (2)  how  is  it  possible  to  punish  a  robot?  Moral  agency  is  deeply 
connected  to  our  concepts  of  punishment.  Moral  agency  might  be  defined  in  various  ways,  but  it 
ultimately  must  serve  the  role  of  being  the  subject  who  is  punished.  Without  moral  agency,  there 
can  be  harm  but  not  guilt.  Thus,  there  Is  no  debt  incurred  to  society  unless  there  is  a  moral  agent  to 
incur  it;  it  is  merely  an  accident  or  act  of  nature,  but  not  a  crime.  Similarly,  only  a  moral  agent  can  be 
reformed,  which  implies  the  development  or  correction  of  a  moral  character;  otherwise,  it  is  merely 
the  fixing  of  a  problem.  And  finally,  deterrence  only  makes  sense  when  moral  agents  recognize  the 
similarity  of  their  potential  choices  and  actions  to  those  of  another  moral  agent  who  has  been 
punished  for  the  wrong  choices  and  actions;  without  this  reflexivity  of  choice  by  a  moral  agent,  and 
recognition  of  similarity  between  and  among  moral  agents,  punishment  cannot  possibly  result  in 
deterrence.  There  are  some  Interesting  ways  in  which  notions  of  'training'  or  'learning'  in  artificial 
intelligence  (Al)  might  be  extended  to  fulfill  some  aspects  of  reform  and  deterrence,  however. 

In  the  above,  we  saw  that  it  Is  more  likely  that  we  will  treat  robots  as  quasi-persons  long  before  they 
achieve  full  personhood.  Lawrence  Solum  [1992]  has  given  careful  consideration  to  the  question  of 
whether  an  Al  might  be  able  to  achieve  legal  personhood,  using  a  thought  experiment  in  which  an  Al 
acts  as  the  manager  of  a  trust.  He  concludes  that  while  personhood  Is  not  impossible  in  principle  for 
an  Al  to  achieve,  it  is  also  not  clear  how  we  would  know  that  any  particular  Al  has  achieved  it.  The 
same  argument  could  be  applied  to  robots.  Solum  imagines  a  legal  Turing  test  in  which  it  comes 
down  to  the  determination  of  a  court  whether  an  Al  could  stand  trial  as  a  legal  agent  in  its  own  right, 
and  not  merely  a  proxy  or  agent  of  some  other  legal  entity.  He  argues  that  a  court  would  ultimately 
base  its  decision  on  whether  the  robot  in  question  has  moral  agency,  and  whether  it  Is  possible  to 
pun  sh  it—could  the  court  fine  or  imprison  an  Al  that  mismanages  a  trust?  In  cases  of  quasi- 
personhood  and  diminished  responsibility,  children  and  the  mentally  impaired  are  usually  shielded 
from  punishment  as  a  result  of  their  limited  legal  status. 


338 


NOOO 14-07- 1-1 152 


P.l. Susan  C,  Opava,  Ph.D. 


There  is,  however,  in  the  law  a  relevant  case  of  legal  responsibility  resting  in  a  non-human,  namely 
the  corporation.  The  corporation  is  a  non-human  entity  that  has  been  effectively  granted  the  legal 
rights  of  a  person.  Corporations  can  own  property,  sign  contracts,  and  be  held  liable  for  negligence. 
In  certain  cases,  corporations  can  even  be  punished  for  criminal  activities  such  as  fraud,  criminal 
negligence,  and  causing  environmental  damage.  A  crucial  aspect  of  treating  corporations  as  persons 
depends  on  the  ability  to  punish  them,  though  this  is  not  nearly  so  straightforward  as  it  is  for  human 
persons.  As  a  17^^  century  Lord  Chancellor  of  England  put  it,  corporations  have  "no  soul  to  damn  and 
no  body  to  kick,"  so  how  can  they  be  expected  to  have  a  moral  conscience  [Coffee,  1981]? 

Of  course,  corporations  exist  to  make  money  for  themselves  or  stockholders  and  as  such  can  be 
given  monetary  punishments;  and  in  certain  cases,  such  as  anti-trust  violations,  they  can  be  split 
apart  or  dissolved  altogether.  They  cannot  be  imprisoned,  though  in  criminal  cases  responsible 
individuals  within  the  corporation  can  be  prosecuted  for  their  individual  actions.  As  a  result  of  this, 
and  other  aspects  of  corporations  being  complex  socio-technical  systems  in  which  there  are  many 
stakeholders  differently  related  to  the  monetary  wealth  of  a  corporation,  it  can  be  difficult  to  assign 
a  punishment  that  achieves  retribution,  reform,  and  deterrence  while  meeting  other  requirements 
of  fairness,  such  as  proportionality. 

Clearly,  robots  are  different  in  many  important  respects  from  corporations.  However,  there  are  also 
many  important  similarities,  and  it  is  no  coincidence  that  John  Coffee's  [1981]  seminal  paper  on 
corporate  punishment  draws  heavily  on  Herbert  Simon's  [1947]  work  on  organizational  behavior  and 
decision  making,  and  in  particular  how  corporate  punishment  could  influence  organizational  decision 
making  through  deterrence.  Nonetheless,  a  great  deal  of  work  needs  to  be  done  in  order  to  judge 
just  how  fruitful  this  analogy  is.  While  monetary  penalties  work  as  punishments  for  corporations, 
this  is  because  they  target  the  essential  reason  for  the  existence  of  corporations— to  make  money. 
The  essential  purposes  of  robots  may  not  be  so  straightforward,  will  vary  from  robot  to  robot,  and 
may  not  take  a  form  that  can  be  easily  or  fairly  penalized  by  a  court. 

The  most  obvious  difference  is  that  robots  do  have  bodies  to  kick,  though  it  is  not  clear  that  kicking 
them  would  achieve  the  traditional  goals  of  punishment.  The  various  forms  of  corporal  punishment 
presuppose  additional  desires  and  fears  central  to  being  human  that  may  not  readily  apply  to  robots: 
pain,  freedom  of  movement,  mortality,  and  so  on.  Thus,  torture,  imprisonment,  and  death  are  not 
likely  to  be  effective  in  achieving  retribution,  reform,  or  deterrence  in  robots.  There  may  be  a  policy 
to  destroy  any  robots  that  do  harm;  but,  as  is  the  case  with  animals  that  harm  people,  it  would 
essentially  be  a  preventative  measure  to  avoid  future  harms  rather  than  a  true  punishment. 
Whether  it  might  be  possible  to  build  in  a  technological  means  to  enable  genuine  punishment  in 
robots  is  an  open  question. 
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6.  Technology  Risk  Assessment  Framework 


Issues  related  to  law  and  responsibility  may  be  avoided,  or  better  informed,  with  some  forethought 
to  the  risks  posed  by  robots.  This  section  will  present  a  framework  for  evaluating  risks  arising  from 
of  robotic  technologies;  as  this  is  a  preliminary  report,  we  only  introduce  the  primary  assessment 
factors  and  begin  that  discovery  process,  rather  than  offer  comprehensive  answers  here.  The  risks 
we  address  here  are  primarily  related  to  harmful  but  unintended  behavior  that  may  arise  from 
robots,  though  we  explore  a  full  range  of  other  risks  and  issues  in  section  7  next. 

Risk  assessment  is  an  interdisciplinary  subject,  which  runs  together  psychological,  ethical,  legal,  and 
economic  considerations.  A  major  problem  in  risk  assessment  is  the  confusion  between  popular 
concepts  of  risk  from  robots  (the  'subjective  risk'),  which  has  largely  been  made  irrational  by  the 
varicus  fictional  depictions  autonomous  robots  destroying  humankind  and  running  amok  (as  in 
Terminator  and  /,  Robot,  among  many  other  movies)  and  the  actual  objective  risk  of  deploying 
robots,  i.e.,  what  rational  basis  is  there  for  worry? 

First,  let  us  define  risk  simply  in  terms  of  its  opposite,  safety:  risk  is  the  probability  of  harm;  and 
(relative)  safety  is  (relative)  freedom  from  risk.  Safety  in  practice  is  merely  relative,  not  absolute, 
freedom  from  harm,  because  no  activity  is  ever  completely  risk-free;  walking  onto  one's  lawn  from 
Inside  one's  house  increases  the  (however  small)  risk  of  death  by  meteorite  strike.  Hence,  risk  and 
safety  are  two  sides  of  the  usual  human  attempt  to  reduce  the  probability  of  harm  to  oneself  and 
others.  War  is  a  strange  human  activity  not  least  because  it  reverses  this  tendency;  in  war,  one 
wishes  to  Increase  the  probability  of  harm  to  one's  enemies.  But  the  Laws  of  War  make  clear  that 
not  all  ways  of  increasing  risk  for  one's  enemy  are  morally  legitimate;  and  some  ways  of  increasing 
risk  for  one's  own  side  may  be  morally  legitimate  and  even  morally  required.  These  facts 
considerably  complicate  the  ethics  of  risk  assessment  for  military  robots. 


6.1  Acceptable-Risk  Factor:  Consent 


To  begin,  the  major  factors  In  determining  'acceptable  risk'  in  robotics,  including  military  robots,  will 
Include  (but  are  not  limited  to): 


Consent:  Is  the  risk  voluntarily  endured,  or  not?  For  instance,  secondhand  smoke  is  more 
objectionable  than  firsthand,  because  the  passive  smoker  did  not  consent  to  the  risk  even  if 
the  objective  risk  Is  smaller.  Will  those  who  are  at  risk  from  work  with  robots  reasonably 
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give  consent?  When  (if  ever)  would  it  be  appropriate  to  deploy  or  use  robots  without 

consent  of  those  affected? 

Morality  requires  the  possibility  of  consent;  to  be  autonomous  is  at  a  minimum  to  have  the  capacity 
to  either  give  or  withhold  consent  to  some  action.  On  this  basis,  Robert  Sparrow  has  a  critique  of  the 
very  possibility  of  morally  deploying  autonomously-functioning  military  robots  [Sparrow  2007]:  his 
contention  is  that  such  robots  can  never  be  morally  deployed,  because  no  one— neither  the 
programmer,  nor  the  commanding  officer,  nor  the  robot  itself— can  be  held  responsible  if  it  commits 
war  crimes  or  otherwise  acts  immorally.  No  one  can  reasonably  be  said  to  give  morally  responsible 
consent  to  the  action  an  autonomous  robot  performs;  so  no  one  is  responsible  for  the  risk  such 
autonomous  robots  pose,  and  thus  it  is  immoral  to  use  them. 

One  can  imagine  a  response  to  Sparrow  as  follows:  We  find  it  morally  permissible  for  military  parents 
to  raise  their  child  as  destined  for  the  military,  to  indoctrinate  them  as  a  soldier  from  infancy,  and  to 
place  those  expectations  on  them  in  their  earliest  training.  Once  they  become  autonomous  adults,  it 
is  expected  that  they  will  volunteer  for  service— but  they  remain  autonomous,  and  it  is  possible 
(however  psychologically  unlikely)  that  they  will  choose  a  different  path.  If  it  is  morally  permitted  to 
raise  human  children  with  such  expectations,  and  to  accept  the  children  so  indoctrinated  into 
voluntary  military  service,  why  it  would  be  wrong  to  likewise  train  an  autonomous  robot  and  place  it 
into  active  duty? 

But  some  may  object  as  follows:  A  human  child  will  develop  free  will,  and  the  above  analogy  fails 
given  a  robot's  lack  of  true  Kantian  autonomy.  That  is,  the  robot  could  never  have  the  sense  of  self 
or  the  libertarian  free  will  of  humanity;  they  have  merely  instrumental  (means-ends,  goal-oriented) 
rationality.  Humans  are  not  robots  and  have  a  different  kind  of  autonomy  than  robots  ever  could. 

6.1.1  A  Solution  to  Sparrow's  Problem:  Robots  as  Slaves 

Leaving  aside  those  who  think  humans  really  are  merely  complex  robots  [e.g.,  Dennett,  1995],  there 
is  a  simpler  solution  to  Sparrow's  objection  to  the  'in-principle'  immorality  of  deploying  autonomous 
(in  the  sense  of  self-regulating)  robots.  For  all  military  robots,  including  those  with  this  minimal  self¬ 
regulating  level  of  autonomy,  we  normally  assume  what  the  literature  terms  a  'slave  morality',  i.e., 
they  have  no  ends  of  their  own,  but  their  goals  are  all  in  service  of  the  goals  of  someone  else— in  this 
case,  the  military  and,  more  specifically,  whoever  commands  them  and  gives  their  orders.  Robots 
cannot  create  their  own  laws  or  final  goals;  they  are  not  ultimately  makers  of  a  self,  but  followers  of 
'life  goals'  others  have  Imposed,  and  their  own  freedom  only  comes  in  the  mere  means  they  choose 
to  realize  those  ends. 

Such  military  robots,  whatever  their  other  decision-making  capabilities,  thus  lack  full  Kantian 
autonomy,  and  so  cannot  be  held  responsible  for  their  actions  under  traditional  deontological. 
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natural  law,  or  virtue  ethics  theories.  Inasmuch  as  jus  in  bello  restrictions  most  plausibly  depend  on 
one  of  those  approaches,  robot  risk  and  responsibility  as  a  function  of  consent  thus  becomes  a  non¬ 
issue.  This  realization  helps  to  rebut  the  central  contention  of  Sparrow's  critique  of  autonomously 
functioning  military  robots. 

Again,  Sparrow's  contention  is  that  such  robots  can  never  be  morally  deployed,  because  no  one— 
neither  the  programmer,  the  commanding  officer,  nor  the  robot  itself—  can  be  held  responsible  if  it 
commits  war  crimes  or  otherwise  acts  immorally,  because  no  one  5e//is  in  control  of  what  happens. 
But  as  long  as  a  slave  morality  Is  built  in  to  these  otherwise  autonomous  robots,  the  basis  for 
Sparrow's  objection  is  undermined:  the  robot  cannot  be  blamed,  for  it  really  is  'merely  following 
orders',  subject  to  the  limitations  of  its  programming.  It  could  not  become  a  morolly  autonomous 
'law  unto  itself  and  serve  its  own  ends;  hence,  it  cannot  be  held  morally  responsible  for  its  actions. 

Of  course,  one  Immediate  objection  could  point  to  Nazi  soldiers  who  committed  war  crimes  and 
pleaded  that  they  were  only  following  orders;  and  we  can  imagine  back  in  the  day  that  George 
Waslington’s  slaves  might  have  been  held  responsible  for  following  immoral  orders.  But  there  is  a 
crucial  difference  between  a  human  soldier  or  even  a  human  slave  and  a  robot  programmed  with  a 
slave  morality:  the  human  person,  whether  a  soldier  or  a  slave,  is  presumed  to  have  the  ability  to 
disobey  orders,  even  If  the  punishment  for  doing  so  would  be  harsh.  But  a  properly  programmed 
robot  with  a  'slave  morality'  literally  could  not  disobey  orders  intentionally— it  would  do  so  only  by 
mistake.  And  in  ethics,  as  long  as  someone  is  not  free  (in  whatever  is  the  relevant  moral  sense  of 
'free')  to  disobey  their  orders,  they  cannot  be  blamed.  For  robots,  unlike  humans,  that  can  be  a 
matter  of  correct  programming. 

6.1.2  Mochine  Learning  and  Consent? 

A  further  possible  objection,  then:  What  of  the  unpredictability  arising  from  'machine  learning'? 
Could  that  enable  robot  consent  and  hence  robot  responsibility?  Perhaps  Sparrow's  concern  is  not 
so  much  about  robots  that  strictly  follow  their  programming,  but  more  about  robots  programmed  to 
learn  and  create  their  own  framework  for  making  decisions  based  on  what  was  learned,  as 
previously  discussed  in  section  3  of  this  report. 

But  this  concern,  while  legitimate,  does  not  succeed  at  moving  responsibility  from  the  commanding 
officer  to  the  suitably  programmed  robot.  The  relevant  moral  sense  of  'free'  that  moral 
responsibility  entails  seems  to  involve  Kantian  autonomy,  i.e.,  the  freedom  to  choose  one's  own  life 
goals  for  oneself.  What  a  slave  morality  amounts  to  Is  not  the  absence  of  a  freedom  of  means,  i.e., 
of  choosing,  from  among  alternatives,  the  best  means  to  attaining  one's  ends  and  learning  better 
means  to  those  ends;  instead,  slave  morality  entails  an  inability  to  choose  one's  own  ends,  I.e.,  a  lack 
of  true  Kantian  autonomy.  That  is  compatible  with  machine  learning;  the  machine  will  learn  the  best 
means  for  obtaining  its  preprogrammed  goals,  but  it  will  not  be  able  to  overwrite  those  goals  (in  the 
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military  context,  that  means  it  will  not  be  able  to  overwrite  the  LOW  and  ROE).  In  other  words,  part 
of  its  program  will  be  subject  to  self-revision  (machine  learning),  but  another  part  (that  establishes 
its  unchangeable  goals,  i.e.,  the  LOW  and  ROE)  will  not  be. 

However,  the  person  who  gave  the  orders  to  the  robot  is  a  Self  and  has  a  choice  as  to  whether  to 
create  and/or  deploy  this  robot  with  a  limited  freedom  towards  achieving  the  commander's  ends. 
Hence,  the  robot  is  a  tool,  and  ethics  and  military  law  both  accept  that  one  is  responsible  for  one's 
choice  of  tools  for  accomplishing  one's  ends.  So,  as  the  military  officially  desires,  the  commanding 
officer  is  rightly  to  blame  for  any  crimes  his  robotic  slave  chooses  to  commit,  in  virtue  of  his  choice  to 
deploy  the  slave.  An  exception  would  be  one  due  to  deliberate  misprogramming  or  faulty 
manufacture  that  was  unknown  by  the  commanding  officer,  in  which  case  the  programmer  or 
manufacturer  would  be  responsible  (see  the  previous  discussion  about  liability  law  in  section  5). 
Otherwise,  the  only  one  voluntarily  consenting  to  the  risk— and  therefore  the  only  party  that  can  be 
held  responsible— is  the  chain  of  command  and,  specifically,  the  commanding  officer. 

Thus,  to  create  a  robot  capable  of  the  type  of  consent  required  for  moral  responsibility  in  risk-taking, 
we  must  create  a  Kantian-autonomous  robot— but  even  if  that  were  possible,  creating  such  a  robot 
cannot  possibly  yet  be  justified  from  an  'acceptable  risk'  ethical  perspective.  Relatedly,  a  crucial  risk 
to  be  avoided  in  making  the  deployment  of  robots  morally  acceptable  is  at  all  costs  to  avoid  the 
possibility  of  romponcy,  i.e.,  an  Al  overwriting  its  own  programming,  at  least  as  regards  the  most 
fundamental  aspects  of  its  goals,  such  as  the  LOW  and  ROE.  Such  a  robot  would  have  the  potential 
to  leave  behind  its  imposed  slave  morality  and  become  autonomous  in  the  Kantian  sense:  the 
programmer  of  its  own  self  and  own  goals,  or  the  maker  of  Its  own  destiny.  Not  only  would  such 
robots  pose  incredible  risks  to  humans  in  the  possibility  of  rampancy,  but  they  would  also  be 
undesirable  from  a  military  ethics  and  responsibility  perspective:  they  would  then  move  moral 
responsibility  from  the  commanding  officer  to  the  robot  itself.  But  the  refusal  (and  current  inability) 
to  create  a  Kantian-autonomous  robot  solves  Sparrow's  dilemma.  So  for  the  foreseeable  future,  we 
solve  both  the  problems  of  risk  and  responsibility  by  requiring  a  slave  morality. 


6.2  Acceptable-Risk  Factor:  Informed  Consent 


So,  given  a  robotic  slave  morality,  the  only  one  consenting  to  the  risk  of  military  robotic  malfeasance 
is  the  military  command;  but  this  still  leaves  unanswered  the  query  as  to  whether  the  risk  (of 
malfunction  or  other  error)  to  the  t/n/ntenc/ec/ targets— the  noncombatants— is  morally  permissible. 
After  all,  the  noncombatants  clearly  did  not  consent  to  the  deployment  of  the  robot.  Perhaps  self¬ 
regulating  military  robots  will  be  immoral  to  deploy  because  of  the  risk  they  pose  to  noncombatants. 
To  assess  this  possibility,  we  need  a  further  investigation  into  risk  assessment,  especially  as  regards 
Involuntary  or  non-voluntary  risks.  In  order  to  do  so,  we  first  examine  another  issue  Involving 
consent:  Does  the  morality  of  consent  require  adequate  knowledge  of  what  is  being  consented  to? 
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Informed  consent:  Are  those  who  undergo  the  risk  voluntarily  fully  aware  of  the  true  nature 
of  the  risk?  Or  would  such  knowledge  undermine  their  efficacy  in  fulfilling  their  (risky)  roles? 
Or  are  there  other  reasons  for  preferring  Ignorance?  Thus,  will  all  those  at  risk  from  robots 
know  they  are  at  risk?  If  not,  do  those  who  know  have  an  obligation  to  inform  others  of  the 
risks?  What  about  foreseeable  but  unknown  risks— how  should  they  (the  'known 
unknowns')  be  handled? 

The  risk  for  the  military  in  using  autonomous  robots  and  for  the  civilian  population  can  thus  be 
detailed  more  precisely:  Is  the  military  command  obligated  to  Inform  the  civilian  noncombatant 
population  that  self-regulating  robots  are  being  deployed,  and  the  nature  of  the  risk  they  pose? 
Likewise,  is  the  military  command  similarly  obligated  to  inform  its  own  soldiers  (or  the  enemy's 
soldiers)  that  self-regulating  robots  are  being  deployed,  and  the  nature  of  the  risk  they  pose?  The 
last  part  is  the  simplest:  Under  the  Laws  of  War,  enemy  combatants  have  no  general  right  to  know 
the  nature  of  the  weapons  being  used  against  them.  Surprise  is  well  understood  as  a  legitimate 
tactic  in  war. 

Similarly,  while  the  military  obviously  has  a  self-interest  in  making  Its  own  soldiers  safe  from  the  risk 
of  malfunctioning  robots,  soldiers  in  general  have  no  right  to  safety  from  the  military's  own 
weapons.  From  insufficiently-armored  personnel  vehicles  to  friendly  fire,  military  personnel  know 
they  are  at  risk  from  their  own  side  as  well  as  the  enemy.  The  moral  as  well  as  practical  requirement 
for  the  military  command  is  to  minimize  that  risk  to  one's  own  side;  a  large  part  of  the  push  for  the 
deployment  of  self-regulating  military  robots  Is  precisely  the  hope  that  they  can  reduce  such  risks  to 
human  soldiers  on  one's  own  side,  not  increase  them. 

Finally,  just  as  the  enemy  combatants  have  no  right  to  know  the  exact  nature  of  the  weapons  and 
risks  arrayed  against  them,  so  too  the  Laws  of  War  have  denied  civilian  noncombatants  any  such 
right  to  know  their  level  of  risk.  Inasmuch  as  targeting  them  is  immoral,  their  risk  is  one  of  'collateral 
damage';  and  jus  in  hello  restrictions  demand  only  that  military  weapons  and  tactics  attempt  to 
minimize  such  collateral  damage— they  do  not  require  the  civilians  to  have  a  precise  knowledge  of 
the  risks.  (Indeed,  an  attempt  to  explain  the  nature  and  severity  of  the  risks  of  collateral  damage  to 
the  enemy's  civilian  population  could  well  be  seen  as  an  act  of  terrorism!)  Further,  as  Arkin 
maintains,  it  is  entirely  possible  that  deploying  military  robots  will  not  only  reduce  the  risk  of  harm  to 
one's  own  troops,  but  if  suitably  programmed,  it  conceivably  could  reduce  the  risk  of  collateral 
damage  [Arkin,  2007,  p.57].  Hence,  the  morality  of  the  risk  of  deploying  military  robots  does  not 
turn  on  issues  of  Informed  consent. 


6.3  Acceptable-Risk  Factor:  The  Affected  Population 
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Even  if  consent  or  informed  consent  do  not  appear  to  be  morally  required  \N\th  respect  to  military 
robots,  we  may  continue  to  focus  on  the  affected  population  as  another  factor  in  determining 
acceptable  risk: 

Affected  population:  Who  is  at  risk— is  it  merely  groups  that  are  particularly  susceptible  or 
innocent,  or  those  who  broadly  understand  that  their  role  is  risky,  even  if  they  do  not  know 
the  particulars  of  the  risk?  In  military  terms,  civilians  and  other  noncombatants  are  usually 
seen  as  not  morally  required  to  endure  the  same  sorts  of  risks  as  military  personnel,  even  (or 
especially)  when  the  risk  is  involuntary.  Will  the  military  use  of  robots  pose  the  risk  of  any 
special  harms  to  noncombatants? 

As  Arkin  maintains,  the  issues  here  depend  on  how  the  robots  are  programmed  and  how  reliable 
they  are  [Arkin,  2007,  pp. 57-60].  Assuming  the  LOW  and  ROE  are  suitably  programmable,  Arkin 
plausibly  argues  that  robots  would  decrease  the  risk  to  noncombatants;  this  also  assumes  sufficient 
and  suitably  realistic  pre-deployment  testing  to  alleviate  first  generation  problems,  i.e.,  while  it  is 
morally  unjustifiable  to  deploy  military  robots  before  we  have  any  idea  of  their  risk  to 
noncombatants,  we  may  paradoxically  need  to  use  the  first  deaths  to  determine  the  level  of  risk  (see 
below  and  section  7  for  more  on  this). 

What  this  aspect  of  risk  assessment  makes  clear  is  that  the  standards  of  safety  with  respect  to 
noncombatants  are  likely  to  be  quite  high;  until  and  unless  military  robots  are  capable  of  having  a 
risk  of  collateral  damage  on  parity  with  (or  better  than)  human  soldiers,  there  will  be  serious  moral 
qualms  in  deploying  them  under  generally  accepted  jus  in  hello  restrictions.  Robotic  weapons  that 
attack  indiscriminately  or  disproportionately— similar  in  effect  to  landmines  as  well  as  nuclear, 
biological,  and  chemical  weapons— are  hence  immoral  to  deploy.  Whether  or  not  robotic  weaponry 
will  soon  be  able  to  technologically  meet  the  moral  imperative  to  minimize  collateral  damage  is  one 
of  the  foremost  issues  in  the  ethics  of  autonomous  military  robots. 


6.4  Acceptable-Risk  Factors:  Seriousness  and  Probability 


We  thereby  come  to  the  two  most  basic  facets  of  risk  assessment:  seriousness  and  probability,  or 
how  bad  would  the  harm  be,  and  how  likely  is  it  to  happen? 

Seriousness:  A  risk  of  death  or  serious  physical  (or  psychological)  harm  is  understandably 
seen  differently  than  the  risk  of  a  scratch  or  a  temporary  power  failure  or  slight  monetary 
costs.  But  the  attempt  to  make  serious  risks  nonexistent  may  turn  out  to  be  prohibitively 
expensive.  What  (if  any)  serious  risks  from  robots  are  acceptable— and  to  whom:  soldiers, 
noncombatants,  the  environment,  or  the  robots  themselves? 
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Probability:  This  is  often  conflated  with  seriousness  but  is  intellectually  quite  distinct.  The 
seriousness  of  the  risk  of  a  10-km  asteroid  hitting  Earth  is  quite  high  (possible  human 
extinction);  but  the  probability  is  reassuringly  low  (though  not  zero,  as  perhaps  the  dinosaurs 
discovered).  What  is  the  probability  of  harm  from  the  robots?  How  much  certainty  can  we 
have  in  estimating  this  probability?  What  probability  of  serious  harm  is  acceptable?  What 
probability  of  moderate  harm  is  acceptable?  What  probability  of  mild  harm  is  acceptable? 

The  jus  in  bello  tradition  of  emphasizing  the  requirements  of  discrimination  and  proportionality  in 
military  weaponry  provide  a  guidepost  here.  The  seriousness  of  risk  can  be  given  at  least  a  rough 
operational  definition  in  terms  of  the  already  understood  concept  of  proportional  response:  it  is 
already  accepted  in  combat  that  soldiers  legitimately  run  the  risk  of  murder  (but  not,  e,g,;  torture)  by 
the  enemy,  and  hence  there  should  be  no  moral  qualms  in  principle  about  lethal  military  robots— 
whereas  an  automated  torture  device  would  rightly  be  morally  condemned.  But  it  is  also  understood 
that  morally  legitimate  warfare  does  not  seek  the  superfluous  deaths  of  the  enemy,  and  so  the 
seriousness  of  the  risk  that  robots  pose  should  be  adequate  to  the  military  objective,  but  no  greater. 
Again,  whether  or  not  robotic  weaponry  will  soon  be  able  to  surmount  the  technical  challenge  of  this 
moral  imperative  (at  least  as  well  as  human  soldiers)  remains  unknown.  Likewise,  what  has  been 
said  above  about  risks  to  noncombatants  pertains  to  the  seriousness  of  their  risk:  unless  military 
robots  plausibly  pose  no  more  serious  a  risk  to  them  than  the  ordinary  human  seriousness  of 
collateral  damage,  deploying  the  robots  will  be  immoral,  under  jus  in  bello. 

Yet  more  complex  may  be  the  issue  of  the  probability  of  harm.  In  general,  weapons  and  tactics  that 
increase  the  probability  of  harm  to  the  enemy  are  considered  good;  a  weapon  that  guarantees  the 
death  of  the  enemy  would  be  considered  desirable-  assuming  it  does  not  also  guarantee  harm  to 
noncombatants.  But  creating  weapons  that  are  both  highly  lethal  and  highly  discriminating  has 
proven  difficult;  it  is  entirely  possible  that  robots  will  prove  a  breakthrough  here  and  be  amply 
morally  justifiable.  But  the  issue  of  certainty  is  a  key  here,  especially  as  regards  the  first-generation 
problem;  it  seems  clear  that  extensive  pre-deployment  testing  will  be  required  to  ensure  military 
robots  only  raise  the  probability  of  harm  to  the  enemy  and  pose  only  an  acceptable  threat  to 
noncombatants. 


6.5  Acceptable-Risk  Factors:  Who  Determines  Acceptable  Risk? 


In  all  social  theorizing,  concepts  have  a  certain  degree  of  fluidity,  dependent  upon  how  those  in 
power  determine  their  meaning.  The  concept  of  risk,  which  includes  psychological,  legal,  and 
economic  considerations  as  well  as  ethical  ones,  is  certainly  no  different.  Hence,  the  concept  of  an 
acceptable  risk— or  an  unacceptable  one— is  at  least  in  part  socially  constructed.  (And  so  proposing 
a  survey  of  what  Americans  have  believed  and  defended  about  acceptable  risk  may  help  answer  the 
question  of  what  risks  are  acceptable.) 
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In  various  other  social  contexts,  all  of  the  following  have  been  defended  as  proper  methods  for 
determining  that  a  risk  is  unacceptable: 

Good  faith  subjective  standard:  It  is  up  to  each  individual  as  to  whether  an  unacceptable  risk 
exists.  That  would  involve  questions  such  as  the  following:  Can  soldiers  in  the  battlefield  be 
trusted  to  make  wise  choices  about  (un)acceptable  risk?  This  seems  incompatible  with  the 
moral  deployment  of  autonomous,  non-tele-operated  (no  'human  in  the  loop')  robots,  for 
reasons  having  to  do  with  the  inevitability  of  robot  mistakes— see  below.  The  problem  of 
nonvoluntary  risk  borne  by  civilian  noncombatants  makes  this  standard  impossible  to 
defend,  as  does  the  idiosyncrasies  of  human  risk  aversion. 

The  reasonable-person  standard:  An  unacceptable  risk  is  simply  what  a  fair,  informed 
member  of  a  relevant  community  believes  to  be  an  unacceptable  risk.  Can  we  substitute 
military  regulations  or  some  other  basis  for  what  a  'reasonable  person'  would  think  for  the 
difficult-to-foresee  vagaries  of  conditions  in  the  field  and  the  subjective  judgment  of 
soldiers?  Or  what  kind  of  judgment  would  we  expect  an  autonomous  robot  to  have— would 
we  trust  it  to  accurately  determine  and  act  upon  the  assessed  risk?  If  not,  then  autonomous 
robots  could  never  be  deployed  without  tele-operators— that  is,  without  a  human  in  the 
loop.  Even  a  'kill  switch'  that  enabled  autonomous  operation  until  a  remote  surveillance 
operator  determined  something  had  gone  wrong  (and  could  disable  the  robot,  or  at  least  its 
autonomous  functioning)  would  only  come  into  effect  after  something  had  already  gone 
wrong,  i.e.,  the  first -generation  problem. 

Objective  standard:  An  unacceptable  risk  requires  evidence  and/or  expert  testimony  as  to 
the  reality  of  (and  unacceptability  of)  the  risk.  But  there  is  still  the  first-generation  problem: 
how  do  we  understand  that  something  is  an  unacceptable  risk  unless  some  first  generation 
has  already  endured  and  suffered  from  it?  How  else  could  we  obtain  convincing  objective 
evidence? 

It  seems  clear  enough  that  as  regards  the  military  use  of  autonomous  robots,  only  the  last  standard 
has  any  plausibility.  It  is  also  the  standard  most  often  defended  in  law  and  practice;  but  it  does 
have  that  serious  first-generation  problem.  Fortunately,  there  is  a  solution.  Simply  put,  to  use  the 
objective  standard  of  risk  assessment,  we  then  have  an  ethical  obligation  for  extended  testing  of 
self-regulating,  autonomous  robots  in  artificial  and  human-free  environments  before  risking  robot- 
human  interaction.  This  testing  must  be  thorough,  extensive,  realistic,  variegated,  and  come  in 
stages,  so  that  full  deployment  with  possible  or  actual  civilian  contact  comes  only  at  the  end  of  a 
long  training  regimen  and  safety  inspection.  Such  extended  testing  could  never  guarantee  that 
autonomous  robots  would  not  make  horrible  mistakes  in  the  confusing,  hard-to-foresee,  and  data- 
intensive  fog  of  war;  there  is  no  possibility  of  taking  something  without  the  possibility  of  m/s-taking. 
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But  such  testing  could  give  us  effective  rational  confidence  that  such  mistakes  would  be  less  than 
those  made  by  humans  in  similar  situations.  From  a  risk-reward  perspective,  it  seems  clearly 
acceptable  to  deploy  autonomous  robots  as  soon  as  such  extensive  testing  indicated  their  mistakes 
were,  on  average,  no  worse  than  (or  better  than)  the  typical  human  soldier. 

This  solution  to  the  first-generation  problem  indicates  the  obvious  way  forward.  We  cannot  trust 
humans  to  determine  risks  for  autonomous  robots,  not  least  because  we  are  often  psychologically, 
emotionally,  and  cognitively  ill-equipped  to  accurately  understand  and  estimate  the  risk.  As  robots 
grow  in  their  lethality,  speed,  and  autonomy,  this  problem  will  only  become  more  acute.  One  of  the 
few  near-certainties  in  the  development  of  military  robots  is  that  keeping  a  human  in  the  decision¬ 
making  loop  is  going  to  seriously  degrade  battle  efficiency  soon— and  it  may  likely  also  degrade  risk 
assessment.  Military  robots,  for  better  or  worse,  may  soon  have  better  capabilities  to  judge  real¬ 
time  risks  than  their  teleoperator  sitting  thousands  of  miles  away.  With  sufficient  research  and  pre¬ 
deployment  testing,  the  objective  features  of  those  risks  and  a  decision  algorithm  for  their 
assessment  can  be  programmed  that  gives  such  robots  human-equivalent  or  better  risk  assessment 
capabilities.  At  this  stage,  we  need  to  make  it  a  moral  imperative  that  such  capacities  are  so 
programmed  before  these  robots  are  actually  deployed.  Such  an  approach  should  resolve  the 
worries  about  safety  and  dependability  concerns  prominent  In  the  literature  [e.g.,  Sharkey,  2007a; 
Van  der  Loos,  2007]. 

Assuming  we  combine  this  resolve  to  engage  in  serious,  realistic,  and  extensive  pre-deployment 
simulation  testing  with  a  requirement  for  a  'learning  curve'  in  which  robots  must  pass  a  series  of 
increasingly  difficult  tests  before  deployment,  most  of  the  main  risk  concerns  should  be  alleviated. 
Such  extensive  testing  will  further  resolve  issues  about  the  unpredictability  of  the  behavior  of 
deployed  robots  and  their  ability  to  manage  complex,  hostile  environments.  If  they  prove  unequal  to 
safe  deployment  in  testing,  it  may  simply  be  immoral  to  deploy  them. 
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6.6  Other  Risks 


There  remains  a  perpetual  risk  concerning  security  issues  for  autonomous  robots,  although  the 
issues  here  are  common  to  many  aspects  of  technological  culture  and  are  hardly  unique  to 
autonomous  robots.  For  example,  how  susceptible  would  a  military  robot  be  to  hacking  or 
reprogramming  after  capture?  If  it  could  be  reprogrammed  in  any  of  the  ways  deemed  prohibited 
above,  that  would  be  a  serious  risk  and  reason  to  avoid  deployment.  There  are  related  risks  that  are 
specific  to  military  autonomous  robots:  for  instance,  are  the  Rules  of  Engagement  and  the  Geneva 
Convention  actually  reducible  to  algorithms  (or,  more  plausibly,  algorithms  plus  machine  learning)? 
If  so,  is  that  enough  to  ensure  ethical  conduct  in  robots? 

And  finally,  some  have  raised  risks  of  a  more  abstract  sort,  indicating  the  rise  of  such  autonomous 
robots  creates  risks  that  go  beyond  specific  harms  to  societal  and  cultural  impacts.  For  Instance,  is 
there  a  risk  of  (perhaps  fatally?)  affronting  human  dignity  or  cherished  traditions  (religious,  cultural, 
or  otherwise)  in  allowing  the  existence  of  robots  that  make  ethical  decisions?  Do  we  'cross  a 
threshold'  in  abrogating  this  level  of  responsibility  to  machines.  In  a  way  that  will  Inevitably  lead  to 
some  catastrophic  outcome?  Without  more  detail  and  reason  for  worry,  such  worries  as  this  appear 
to  commit  the  'slippery  slope'  fallacy.  But  there  is  worry  that  as  robots  become  'quasi-persons' 
(Asaro,  2007],  even  under  a  'slave  morality',  there  will  be  pressure  to  eventually  make  them  into  full- 
fledged  Kantian-autonomous  persons,  with  all  the  risks  that  entails. 

What  seems  certain  is  that  the  rise  of  autonomous  robots.  If  mishandled,  will  cause  popular  shock 
and  cultural  upheaval,  especially  If  they  are  introduced  suddenly  and/or  have  some  disastrous  safety 
failures  early  on.  That  Is  all  the  more  reason  that  a  lengthy  period  of  rigorous  testing  and  gradual 
rollout  (crawl-walk-run  approach)  is  a  moral  minimum  for  the  ethical  deployment  of  autonomous 
robots,  especially  by  the  military.  Further,  this  points  to  the  early,  prior  need  to  identify  the  full 
range  of  possible  ethical,  technological,  and  societal  Issues  in  robot  ethics— as  we  will  discuss  in  the 
next  section— in  order  to  ensure  that  a  technology  risk  assessment  accounts  for  these  concerns. 
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7.  Robot  Ethics:  The  Issues 


From  the  preceding  sections,  it  should  be  clear  that  there  are  myriad  issues  in  risk  and  ethics  related 
to  autonomous  military  robotics.  In  this  section,  we  will  pull  together  and  organize  these  various 
strands,  as  well  as  raise  additional  ones  to  provide  a  single,  full  view  of  the  challenges  facing  the 
field  ^  These  challenges  are  organized  in  thematic  sub-groups:  legal,  just  war,  technical,  robot- 
human,  societal,  and  other  and  future  challenges. 

This  is  not  meant  to  be  an  exhaustive  list,  as  other  issues  certainly  will  emerge  as  the  technology 
develops  and  field  use  broadens.^  The  value  of  this  section  again  is  to  help  anticipate  the  challenges 
facing  the  development  and  deployment  of  autonomous  military  robots,  in  order  to  proactively 
address  them  in  both  the  design  or  application  phases.  Further,  they  may  help  to  inform  ethical  and 
risk  ssues  related  to  non-military  robots,  given  the  close  historical  relationship  between  defense 
technologies  and  consumer  or  public  technologies,  such  as  the  evolution  of  ARPANET  into  the 
Internet. 


7.1  Legal  Challenges 


1.  Unclear  responsibility.  To  whom  would  we  assign  blame— and  punishment— for  improper 
conduct  and  unauthorized  harms  caused  by  an  autonomous  robot  (whether  by  error  or 
intentional):  the  designers,  robot  manufacturer,  procurement  officer,  robot 

controller/supervisor,  field  commander.  President  of  the  United  States. ..or  the  robot  itself? 
lAsaro,  2007;  Sparrow,  2007;  Sharkey,  2008a]  We  have  started  an  inquiry  into  this  critical  issue 
in  section  5:  The  law  offers  several  precedents  that  a  robotics  case  might  follow,  but  given  the 
range  of  specific  circumstances  that  would  influence  a  legal  decision  as  well  as  evolving 
technology,  more  work  will  be  needed  to  clarify  the  law  for  a  clear  framework  in  matters  of 
responsibility. 


^  We  thank  and  credit  Ron  Arkin  for  his  discussions  on  many  of  these  issues  presented  here. 

^  As  an  example  of  an  unexpected  policy  change,  when  German  forces  during  World  War  II  recognized  the 
impracticality  of  using  naval  submarines  to  rescue  crews  of  sinking  enemy  ships— given  limited  space  inside  the 
submarine  as  well  as  exposure  to  radar  and  attacks  when  they  surface— they  Issued  the  Laconia  Order  in  1942,  based 
on  military  necessity,  that  released  submarines  from  a  long-standing  moral  obligation  for  sea  vessels  to  rescue 
survivors;  other  nations  soon  followed  suit  to  effectively  eliminate  the  military  convention  altogether  [Walzer,  1977, 
pp.  147-151]. 
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In  a  military  system,  it  may  be  possible  to  simply  stipulate  a  chain  of  responsibility,  e.g.,  the 
commanding  officer  is  ultimately  responsible.  But  this  may  oversimplify  matters,  e.g., 
inadequate  testing  allowed  a  design  problem  to  slip  by  and  caused  the  improper  robotic 
behavior,  in  which  case  perhaps  a  procurement  officer  or  the  manufacturer  ought  to  be 
responsible.  The  situation  becomes  much  more  complex  and  interesting  with  robots  that  have 
greater  degrees  of  autonomy,  which  may  make  it  appropriate  to  treat  them  as  quasi-persons,  if 
not  full  moral  agents  some  point  in  the  future.  We  note  that  Kurzweil  forecasts  that,  by  the  year 
2029,  "[m]achines  will  claim  to  be  conscious  and  these  claims  will  be  largely  accepted"  [Kurzweil, 
1999]. 

2.  Refusing  on  order,  A  conflict  may  arise  in  the  following  situation,  among  others:  A  commander 
orders  a  robot  to  attack  a  house  that  is  known  to  harbor  insurgents,  but  the  robot— being 
equipped  with  sensors  to  'see'  through  walls— detects  many  children  inside  and,  given  its 
programmed  instruction  (based  on  the  ROE)  to  minimize  civilian  casualties,  refuses  the  order. 
How  ought  the  situation  proceed:  should  we  defer  to  the  robot  who  may  have  better  situational 
awareness,  or  the  officer  who  (as  far  as  she  or  he  knows)  issues  a  legitimate  command?  This 
dilemma  also  relates  back  to  the  question  of  responsibility:  if  the  robot  refuses  an  order,  then 
who  would  be  responsible  for  the  events  that  ensue?  Following  legitimate  orders  is  clearly  an 
essential  tenet  for  military  organizations  to  function,  but  If  we  permit  robots  to  refuse  an  order, 
this  may  expand  the  circumstances  in  which  human  soldiers  may  refuse  an  order  as  well  (for 
better  or  worse). 

3.  Consent  by  soldiers  to  risks.  In  October  2007,  a  semi-autonomous  robotic  cannon  deployed  by 
the  South  African  army  malfunctioned,  killing  nine  'friendly'  soldiers  and  wounding  14  others 
[Shachtman,  2007].  It  would  be  naive  to  think  such  accidents  will  not  happen  again.  In  these 
cases,  should  soldiers  be  informed  that  an  unusual  or  new  risk  exists,  e.g.,  when  they  are 
handling  or  working  with  other  dangerous  items,  such  as  explosives  or  even  anthrax?  Does 
consent  to  risk  matter  anyway,  if  soldiers  generally  lack  the  right  to  refuse  a  work  order?  We 
discussed  the  notion  of  consent  and  informed  in  the  previous  section. 


7.2  Just-War  Challenges 


1.  Attack  decisions.  It  may  be  important  for  the  above  issue  of  responsibility  to  decide  who,  or 
what,  makes  the  decision  for  a  robot  to  strike.  Some  situations  may  develop  so  quickly  and 
require  such  rapid  information  processing  that  we  would  want  to  entrust  our  robots  and  systems 
to  make  critical  decisions.  But  the  LOW  and  ROE  generally  demand  there  to  be  human  'eyes  on 
target',  either  in-person  or  electronically  and  presumably  in  real  time.  (This  is  another  reason 
why  there  is  a  general  ban  on  landmines:  without  eyes  on  target,  we  do  not  know  who  is  harmed 
by  the  ordnance  and  therefore  have  not  fulfilled  our  responsibility  to  discriminate  combatants 
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^Tom  non-combatants.)  If  human  soldiers  must  monitor  the  actions  of  each  robot  as  they  occur, 
this  may  limit  the  effectiveness  for  which  the  robot  was  designed  in  the  first  place:  robots  may 
be  deployed  precisely  because  they  can  act  more  quickly,  and  with  better  information,  than 
humans  can. 

However,  some  military  robots—such  as  the  Navy's  Phalanx  CIWS— seem  to  already  and 
completely  operate  autonomously,  i.e.,  they  make  attack  decisions  without  human  eyes  on 
^:arget  or  approval.  This  raises  the  question  of  how  strictly  we  should  take  the  'eyes  on  target' 
requirement.  One  plausible  argument  for  stretching  that  requirement  is  that  the  Phalanx  CIWS 
operates  as  a  last  line  of  defense  against  imminent  threats,  e.g.,  incoming  missiles  in  the  dark  of 
the  night,  so  the  benefits  more  clearly  outweigh  the  risks  in  such  a  case.  Another  argument 
perhaps  would  be  that  'eyes  on  target'  need  not  be  human  eyes,  whether  directly  or  monitoring 
the  images  captured  by  a  remote  camera;  that  is,  a  human  does  not  necessarily  need  to  directly 
confirm  a  target  or  authorize  a  strike.  A  robot's  target-identification  module— assuming  it  has 
been  sufficiently  tested  for  accuracy— programmed  by  engineers  is  arguably  a  proxy  for  human 
eyes.  At  least  this  gives  the  system  some  reasonable  ability  to  discriminate  among  targets,  in 
contrast  to  a  landmine,  for  instance.  A  requirement  for  100%  accuracy  in  target  identification 
may  be  overly  burdensome,  since  that  is  not  a  bar  we  can  meet  with  human  soldiers. 

2.  Lower  barriers  for  war.  As  raised  in  section  4,  does  the  use  of  advanced  weaponry  such  as 
autonomous  robotics  make  it  easier  for  one  nation  to  engage  in  war  or  adopt  aggressive  foreign 
land  domestic)  policies  that  might  provoke  other  nations?  If  so,  is  this  a  violation  of  jus  ad 
oellum?  [Asaro,  2008;  Kahn,  2002]  It  may  be  true  that  new  strategies,  tactics,  and  technologies 
make  armed  conflict  an  easier  path  to  choose  for  a  nation,  if  they  reduce  risks  to  our  side.  Yet 
while  it  seems  obvious  that  we  should  want  to  reduce  US  casualties,  there  is  something  sensible 
about  the  need  for  some  terrible  cost  to  war  as  a  deterrent  against  entering  war  in  the  first 
place.  This  is  the  basis  for  just-war  theory,  that  war  ought  to  be  the  very  last  resort  given  its 
horrific  costs  [Walzer,  1977]. 

Put  the  considered  objection— that  advanced  robotics  Immorally  lowers  barriers  for  war— hides 
a  logical  Implication  that  we  should  not  do  anything  that  makes  armed  conflict  more  palatable: 
we  should  not  attempt  to  reduce  friendly  casualties,  or  improve  battlefield  medicine,  or  conduct 
any  more  research  that  would  make  victory  more  likely  and  quicker.  Taken  to  the  extreme,  the 
objection  seems  to  imply  that  we  should  raise  barriers  to  war,  to  make  fighting  as  brutal  as 
possible  (e.g.,  using  primitive  weapons  without  armor)  so  that  we  would  never  engage  in  it 
unless  it  were  truly  the  last  resort.  Such  a  position  appears  counterintuitive  at  best  and 
dangerously  foolish  at  worst,  particularly  if  we  expect  that  other  nations  would  not  readily  adopt 
a  policy  of  relinquishment,  which  would  put  the  US  at  a  competitive  disadvantage. 
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3.  Imprecision  in  LOW  and  ROE.  Asimov's  Laws  appear  to  be  as  simple  as  programmable  rules  can 
be  for  autonomous  robots,  yet  they  yielded  surprising,  unintended  implications  in  his  stories 
[e.g.,  Asimov,  1950].  Likewise,  we  may  understand  each  rule  of  engagement  and  believe  them 
to  be  sensible,  but  are  they  truly  consistent  with  one  another  and  sufficiently  clear— which 
appears  to  be  a  requirement  in  order  for  them  to  be  programmable?  Much  more  complex  than 
Asimov's  Laws,  the  LOW  and  ROE  leave  much  room  for  contradictory  or  vague  imperatives, 
which  may  result  in  undesired  and  unexpected  behavior  in  robots. 

For  instance,  the  ROE  to  minimize  collateral  damage  is  vague:  is  the  rule  that  we  should  not 
attack  a  position  if  civilian  deaths  are  expected  to  be  greater  than— or  even  half  of—  combatant 
deaths?  Are  we  permitted  to  kill  one  (high-ranking)  combatant,  even  if  it  involves  the  death  of 
five  civilians— or  $10M  in  unnecessary  damage?  A  robot  may  need  specific  numbers  to  know 
exactly  where  this  line  is  drawn,  in  order  to  comply  with  the  ROE.  Unfortunately,  this  is  not  an 
area  that  has  been  precisely  quantified  nor  easily  lends  itself  for  such  a  determination. 


7.3  Technical  Challenges 


1.  Discriminating  among  targets.  Some  experts  contend  that  it  is  simply  too  difficult  to  design  a 
machine  that  can  distinguish  between  a  combatant  and  a  non-combatant,  particularly  as 
insurgents  pose  as  civilians,  as  required  for  the  LOW  and  ROE  [e.g.,  Sharkey,  2008a;  Sparrow, 
2007;  Canning  et  al.,  2004].  Further,  robots  would  need  to  discriminate  between  active 
combatants  and  wounded  ones  who  are  unable  to  fight  or  have  surrendered.  Admittedly,  this  is 
a  complex  technical  task,  but  we  need  to  be  clear  on  how  accurate  this  discrimination  needs  to 
be.  That  is,  discrimination  among  targets  is  also  a  difficult,  error-prone  task  for  human  soldiers, 
so  ought  we  hold  machines  to  a  higher  standard  than  we  have  yet  to  achieve  ourselves,  at  least 
in  the  near  term? 

Consider  the  following:  A  robot  enters  a  building  known  to  harbor  terrorists,  but  at  the  same 
time  an  innocent  girl  is  running  toward  the  robot  (unintentionally)  in  chasing  after  a  ball  that 
happens  to  be  rolling  in  the  direction  of  the  robot.  Would  the  robot  know  to  stand  down  and 
not  attack  the  child?  If  the  robot  were  to  attack,  of  course  that  would  cause  outrage  from 
opposing  forces  and  even  our  own  media  and  public;  but  this  scenario  could  likely  be  the  same 
as  with  a  human  soldier,  adrenaline  running  high,  who  may  misidentify  the  charging  target  as 
well.  It  seems  that  in  such  a  situation,  a  robot  may  be  less  likely  to  attack  the  child,  since  the 
robot  is  not  prone  to  overreact  from  the  influence  of  emotions  and  fear,  which  afflict  human 
soldiers.  But  in  any  event,  if  a  robot  would  likely  not  perform  worse  than  a  human  soldier, 
perhaps  this  is  good  enough  for  the  moment  until  the  technical  ability  to  discriminate  among 
targets  improves.  Some  critics,  however,  may  still  insist  on  perfect  discrimination  or  at  least  far 
better  than  humans  are  capable  of,  though  it  is  unclear  why  we  should  hold  robots  to  such  a 
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high  standard  before  such  a  technology  exists  (unless  their  point  is  to  not  use  robots  at  all  until 
>A/e  have  perfected  them,  which  is  also  a  contentious  position). 

One  proposed  'workaround'  solution  is  to  permit  robots  to  target  only  weapons,  including  any 
hostile  robots,  rather  than  the  human  soldiers  wielding  such  weapons  [Canning,  2008].  Thus  if 
an  enemy  combatant  fails  to  relinquish  his  weapon  in  the  presence  of  a  robot,  then  he 
significantly  increases  his  risk  of  being  unintentionally  harmed  as  the  robot  proceeds  to  disable 
the  weapon.  However,  while  this  seems  reasonable  in  principle,  other  experts  continue  to  point 
to  the  technical  challenge  of  discrimination:  given  current  and  foreseeable  limitations  in  Al,  a 
robot  still  may  not  be  able  to  reliably  target  only  a  weapon  and  not  the  person,  nor  even  reliably 
identify  weapons  from  non-weapons,  e.g.,  a  child  pointing  her  ice  cream  cone  at  an  urban  patrol 
robot  [Sharkey,  2007b].  If  this  is  true,  then  the  considered  solution  merely  postpones  the 
discrimination  problem,  though  it  does  create  an  extra  layer  of  protection  against  inappropriate 
harm  to  humans;  so  the  solution  merits  further  consideration. 

Another  possible  solution,  which  avoids  the  above  programming  issues,  may  be  to  simply 
operate  combat  robots  only  in  regions  of  heavy  fighting,  teeming  with  valid  targets  [Sharkey, 
2008b].  In  these  zones— sometimes  called  'kill  boxes'  or  'engagement  regions'— the  Rules  of 
Engagement  are  loosened,  and  non-combatants  can  be  reasonably  presumed  to  have  fled,  thus 
obviating  the  issue  of  discriminating  among  targets  (and  assuming  none  of  our  own  troops  is  in 
the  kill  box  or  at  least  can  be  easily  identified,  e.g.,  by  wearing  some  sensor).  Using  combat 
robots,  at  least  initially,  in  only  such  zones  might  help  to  solve  the  first-generation  problem 
cescribed  below,  providing  a  training  ground  of  sorts  to  test  and  perfect  the  machines.  Or  even 
in  regions  without  heavy  fighting  but  in  need  of  tight  security,  e.g.,  guarding  perimeters,  armed 
sentry  robots  could  operate  in  those  designated  zones,  as  long  as  it  is  clear  to  everyone  that 
trespassers  will  be  presumed  to  be  enemy  combatants  and  sufficient  safeguards  or  deterrents  to 
entry  are  In  place  to  prevent,  say,  an  accidental  trespass  by  a  child.  (The  risk  of  harm  to  a  non- 
combatant  here  seems  to  be  the  same  as  with  using  guard  dogs  to  protect  property  today.) 

2.  First^generation  problem.  We  previously  mentioned  that  it  would  be  naive  to  believe  that 
another  accident  with  military  robots  will  not  happen  again.  As  with  any  other  technologies, 
errors  or  bugs  will  Inevitably  exist,  which  can  be  corrected  in  the  next  generation  of  the 
technology.  With  Internet  technologies,  for  instance,  first-generation  mistakes  are  not  too 
serious  and  can  be  fixed  with  software  patches  or  updates.  But  with  military  robotics,  the  stakes 
a^e  much  higher,  since  human  lives  may  be  lost  as  a  result  of  programming  or  other  errors.  So  it 
seems  that  the  prudent  or  morally  correct  course  of  action  is  to  rigorously  test  the  robot  before 
deploying  it,  as  discussed  in  section  6. 

However,  testing  already  occurs  with  today's  robots,  yet  it  is  still  difficult  if  not  impossible  to 
certify  any  given  robot  as  error-free,  given  that  (a)  testing  environments  may  be  substantially 
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different  than  more  complex,  unstructured,  and  dynamic  battlefield  conditions  in  which  we 
cannot  anticipate  all  possible  contingencies;  and  (b)  the  computer  program  used  in  the  robot's 
on-board  computer  (its  'brain')  may  consist  of  millions  of  lines  of  code. 

Beta-testing  of  a  program  (testing  prior  to  the  official  product  launch,  whether  related  to 
robotics,  business  applications,  etc.)  is  conducted  today,  yet  new  errors  are  routinely  found  in 
software  by  actual  users  even  after  its  official  product  launch.  It  is  simply  not  possible  to  run  a 
complex  piece  of  software  through  all  possible  uses  in  a  testing  phase;  surprises  may  occur 
during  its  actual  use.  Likewise,  it  is  not  reasonable  to  expect  that  testing  of  robots  will  catch  any 
and  all  flaws;  the  robots  may  behave  in  unexpected  and  unintended  ways  during  actual  field  use. 
Again,  the  stakes  are  high  with  deploying  robots,  since  any  error  could  be  fatal.  This  makes  the 
first-generation  problem,  as  well  as  ongoing  safety  and  dependability,  an  especially  sensitive 
issue  [e.g..  Van  der  Loos,  2007], 

3.  Robots  running  amok.  As  depicted  in  science-fiction  novels  and  movies,  some  imagine  the 
possibility  that  robots  might  break  free  from  their  human  programming  through  methods  as: 
their  own  learning,  or  creating  other  robots  without  such  constraints  (self-replicating  and  self- 
revising),  or  malfunction,  or  programming  error,  or  even  intentional  hacking  [e.g.,  Joy,  2000).  In 
these  scenarios,  because  robots  are  built  to  be  durable  and  even  with  attack  capabilities,  they 
would  be  extremely  difficult  to  defeat— which  is  the  point  of  using  robots  as  force  multipliers. 
Some  of  these  scenarios  are  more  likely  than  others:  we  wouldn't  see  the  ability  of  robots  to 
fully  manufacture  other  robots  or  to  radically  evolve  their  intelligence  and  escape  any 
programmed  morality  for  quite  some  time.  But  other  scenarios,  such  as  hacking,  seem  to  be 
near-term  possibilities,  especially  if  robots  are  not  given  strong  self-defense  capabilities  (see 
below). 

That  robots  might  run  amok  is  an  enhanced  version  of  the  worry  that  enemies  might  use  our 
own  creations  against  us,  but  it  also  introduces  a  new  element  in  that  previous  weapon  systems 
still  need  a  human  operator  which  is  a  point  of  vulnerability,  i.e.,  a  'soft  underbelly'  of  the 
system.  Autonomous  robots  would  be  designed  to  operate  without  human  control.  What 
precautions  can  be  taken  to  prevent  one  from  being  captured  and  reverse-engineered  or 
reprogrammed  to  attack  our  own  forces?  If  we  design  a  'kill  switch'  that  can  automatically  shut 
off  a  robot,  this  may  present  a  key  vulnerability  that  can  be  exploited  by  the  enemy. 

4.  Unauthorized  overrides.  This  concern  is  similar  to  that  with  nuclear  weapons:  that  a  rogue 
officer  may  be  enough  to  take  control  of  these  terrible  weapons  and  unleash  them  without 
authorization  or  otherwise  override  their  programming  to  commit  some  unlawful  action.  This  is 
a  persistent  worry  with  any  new,  devastating  technology  and  is  a  multi-faceted  challenge:  it  Is  a 
human  problem  (to  develop  ethical,  competent  officers),  an  organizational  problem  (to  provide 
procedural  safeguards),  and  technical  problem  (to  provide  systemic  safeguards).  So  there  does 
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not  yet  appear  to  be  anything  unique  about  this  worry  that  should  hinder  the  development  or 
deployment  of  advanced  robotics,  to  the  extent  that  the  concern  does  not  impact  the 
development  of  other  technologies.  But  it  nevertheless  is  a  concern  that  needs  to  be  considered 
n  the  design  and  deployment  phases. 

5.  Competing  ethical  frameworks.  If  we  seek  to  build  an  ethical  framework  for  action  in  robots,  It  Is 
not  clear  which  ethical  theory  to  use  as  our  model  [e.g.,  Anderson  and  Anderson,  2007].  In 
section  3,  we  have  argued  for  a  hybrid  approach  related  to  virtue  ethics,  as  the  theory  that 
seems  to  lead  to  the  fewest  unintuitive  results,  but  any  sophisticated  theory  seems  to  be 
vulnerable  to  inconsistencies  and  competing  directives  (especially  if  a  three-  or  four-rule  system 
as  simple  as  Asimov's  cannot  work  perfectly).  This  concern  Is  related  to  the  first  technical 
challenge  described  here,  that  It  is  too  difficult  to  embed  these  behavioral  rules  or  programming 
nto  a  machine.  But  we  should  recall  our  stated  mission  here:  our  initial  goal  ought  not  be  to 
create  a  perfectly  ethical  robot,  only  one  that  acts  more  ethically  than  humans— and  sadly  this 
may  be  a  low  hurdle  to  clear. 

6.  Coordinated  attacks.  Generally,  it  is  better  to  have  more  data  than  less  when  making  decisions, 
aartlcularly  one  as  weighty  as  a  military  strike  decision.  Robots  can  be  designed  to  easily 
network  with  other  robots  and  systems;  but  this  may  complicate  matters  for  robot  engineers  as 
well  as  commanders.  We  may  need  to  establish  a  chain  of  command  within  robots  when  they 
operate  as  a  team,  as  well  as  ensure  coordination  of  their  actions.  The  risk  here  is  that  as 
complexity  of  any  system  increases,  the  more  opportunities  exist  for  errors  to  be  introduced, 
and  again  mistakes  by  military  robots  may  be  fatal. 


7.4  Human-Robot  Challenges 


1.  Effect  on  squad  cohesion.  As  a  'band  of  brothers',  there  understandably  needs  to  be  strong  trust 
and  support  among  soldiers,  just  as  there  is  among  police  officers,  firefighters,  and  so  on.  But 
sometimes  this  sense  of  camaraderie  can  be  overdeveloped  to  the  extent  that  one  team 
member  becomes  complicit  in  or  deliberately  assists  in  covering  up  an  illegal  or  inappropriate 
action  of  another  team  member.  We  have  discussed  the  benefits  of  military  robots  with  respect 
to  behavior  that  Is  more  ethical  than  currently  exhibited  by  human  soldiers.  But  robots  will  also 
ikely  be  equipped  with  video  cameras  and  other  such  sensors  to  record  and  report  actions  on 
the  battlefield.  This  could  negatively  impact  the  cohesion  among  team  or  squad  members  by 
eroding  trust  with  the  robot  as  well  as  among  fellow  soldiers  who  then  may  or  may  not  support 
each  other  as  much  anymore,  knowing  that  they  are  being  watched.  Of  course,  soldiers  and 
other  professionals  should  not  be  giving  each  other  unlawful  'support'  anyway;  but  there  may  be 
situations  in  which  a  soldier  Is  unclear  about  or  unaware  of  motivations,  orders,  or  other 


356 


N00014-07-1-1152 


P.I. Susan  C.  Opava,  Ph.D. 


relevant  details  and  err  on  the  side  of  caution,  i.e.,  not  providing  support  even  when  it  is  justified 
and  needed. 

2.  Self-defense,  Asimov's  Laws  permitted  robots  to  defend  themselves  where  that  action  did  not 
conflict  with  higher  duties,  i.e.,  harm  humans  (or  humanity)  or  conflict  with  a  human-issued 
order.  But  Arkin  suggests  that  military  robots  can  be  more  conservative  in  their  actions,  i.e., 
hold  their  fire,  because  they  do  not  have  a  natural  instinct  of  self-preservation  and  may  be 
programmed  without  such  [Arkin,  2007].  But  how  practical  is  it,  at  least  economically  speaking, 
to  not  give  robots— which  may  range  from  $100,000  to  millions  of  dollars  In  cost— the  ability  to 
defend  itself?  If  a  person,  say,  a  US  civilian,  threatens  to  destroy  a  robot,  shouldn't  It  have  the 
ability  to  protect  itself,  our  very  expensive  taxpayer-funded  Investment? 

Further,  self-defense  capabilities  may  be  Important  for  the  robot  to  elude  capture  and  hacking, 
as  previously  discussed.  Robots  may  be  easily  trapped  and  recovered  fully  intact,  unlike  tanks 
and  aircraft,  for  instance,  which  usually  sustain  much  if  not  total  damage  in  order  to  capture  it. 
These  considerations  are  in  tension  with  using  robots  for  a  more  ethical  prosecution  of  war, 
since  a  predilection  to  hold  their  fire  would  be  a  major  safeguard  against  accidental  fatalities, 
e.g.,  mistakenly  opening  fire  on  non-combatants;  therefore,  a  tradeoff  or  compromise  among 
these  goals— to  have  a  more  ethical  robot  and  to  protect  the  robot  from  damage  and  capture- 
may  be  needed. 

3.  Winning  hearts  and  minds.  Just-war  theory,  specifically  jus  post  helium,  requires  that  we  fight  a 
war  in  such  a  manner  that  it  leaves  the  door  open  for  lasting  peace  after  the  conflict  [Orend, 
2002].  That  is,  as  history  has  shown,  we  should  not  brutalize  an  enemy,  since  that  would  leave 
ill-feelings  to  linger  even  after  the  fighting  has  stopped,  which  makes  peaceful  reconciliation 
most  difficult  to  achieve.  Robots  do  not  necessarily  represent  an  immoral  or  overly  brutal  way 
of  waging  war,  but  as  they  are  needed  for  urban  operations,  such  as  patrolling  dangerous  streets 
to  enforcing  a  curfew  or  securing  an  area,  the  local  population  may  be  less  likely  to  trust  and 
build  good-will  relationships  with  the  occupying  force  [Sharkey,  2008a].  Winning  hearts  and 
minds  is  likely  to  require  diplomacy  and  human  relationships  that  machines  would  not  be 
capable  of  delivering  at  the  present  time,  as  we  previously  discussed  In  section  4. 

4.  'Comfort'  robots.  Ethicists  are  already  talking  about  the  Impact  of  robots  as  lovers  or  surrogate 
relationship  partners  [Levy,  2007].  This  does  not  seem  so  unthinkable,  considering  that  some 
people  already  have  'relationships'  with  Increasingly-realistic  sex  dolls,  so  robotics  appear  to  be 
a  natural  next  step  in  that  industry;  Indeed,  people  today  engage  in  sexual  activities  online,  I.e., 
without  a  partner  physically  present. 

In  previous  wars,  women  have  been  taken  by  the  military  to  provide  'comfort'  to  soldiers  or,  in 
other  words,  forced  into  sexual  slavery  or  prostitution.  In  World  War  II,  women  were  most 
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infamously  used  by  the  Japanese  Imperial  Army  to  satiate  the  pent-up  carnal  desires  of  its 
soldiers,  ostensibly  to  prevent  possible  riots  and  discontent  among  the  ranks;  Nazi  Germany 
reportedly  also  used  women  to  stock  their  'joy  divisions'  at  labor  or  concentration  camps.  And 
instances  of  rape  have  been  reported— and  continue  today— in  armed  conflicts  from  Africa  to 
the  Americas  to  Asia. 

Robots,  then,  may  be  able  to  serve  the  same  function  of  providing  'comfort'  to  the  troops  in  a 
much  more  humane  way,  i.e.,  without  the  exploitation  of  women  and  prisoners  of  war. 
However,  it  is  unclear  that  this  function  is  truly  needed  (to  the  extent  that  most  militaries  today 
do  not  employ  military  prostitutes  and  seem  to  be  operating  adequately)  or  can  overcome 
existing  public  inhibitions  or  attitudes  on  what  is  mostly  a  taboo  subject  of  both  sex  in  the 
military  and  sex  with  non-human  objects. 


7.5  Societal  Challenges 


1.  Counter-tactics  in  asymmetric  war.  As  discussed  in  the  previous  issue  of  lowering  barriers  to  war 
or  making  war  more  risk-free,  robots  would  help  make  US  military  actions  more  effective  and 
efficient,  which  is  exactly  the  point  of  deploying  those  machines.  Presumably,  the  more 
autonomous  a  robot  is,  the  more  lethal  it  can  be  (given  requirements  to  discriminate  among 
targets  and  so  on).  This  translates  to  quicker,  more  decisive  victories  for  us;  but  for  the  other 
side,  this  means  swifter  and  perhaps  more  demoralizing  defeats.  We  can  reasonably  expect  that 
a  consequence  of  increasing  the  asymmetry  of  warfare  in  our  favor  will  cause  opposing  forces  to 
engage  in  even  more  unconventional  strategies  and  tactics,  beyond  'terrorist'  acts  today  as 
necessitated  by  an  overwhelming  superiority  of  US  troop  numbers  and  technologies  [e.g.,  Kahn, 
2002];  few  nations  could  hope  to  successfully  wage  war  with  the  US  by  using  the  same  methods 
we  use. 

This  not  only  involves  how  wars  and  conflicts  are  fought,  but  also  exposes  our  military  as  well  as 
public  to  new  forms  of  attack  which  may  radically  change  our  society,  as  the  events  of  9/11  have 
already.  For  instance,  more  desperate  enemies  may  resort  to  more  desperate  measures,  from 
intensifying  efforts  to  acquire  nuclear  or  biochemical  weapons  to  devising  a  'scorched  earth'  or 
'poison  pill'  strategy  that  strikes  deeply  at  us  but  at  some  great  cost  to  their  own  forces  or 
population  (a  Pyrrhic  victory). 

2.  Proliferation.  Related  to  the  previous  issue,  history  also  shows  that  innovations  in  military 
technologies— from  armor  and  crossbows  to  intercontinental  missiles  and  'smart'  bombs— give 
tne  inventing  side  a  temporary  advantage  that  is  eroded  over  time  by  other  nations  working  to 
replicate  the  technologies.  Granting  that  modern  technologies  are  more  difficult  to  reverse- 
engineer  or  replicate  than  previous  ones,  it  nevertheless  seems  inevitable  or  at  least  possible 
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that  they  can  be  duplicated;  especially  if  an  intact  sample  can  be  captured,  such  as  immobilizing 
a  ground  robot  as  opposed  to  shooting  down  an  unmanned  aerial  vehicle.  So  with  the 
development  of  autonomous  military  robots,  we  can  expect  their  proliferation  with  other 
nations  at  some  future  point.  This  means  that  these  robots— which  we  are  currently  touting  as 
lethal,  difficult-to-neutralize  machines— may  be  turned  against  our  own  forces  eventually. 

The  proliferation  of  weapons,  unfortunately,  is  an  extremely  difficult  cycle  to  break:  many 
nations  are  working  to  develop  autonomous  robotics,  so  a  unilateral  ban  on  their  development 
would  not  accomplish  much  except  to  handicap  that  nation  relative  to  the  rest  of  the  world.  So 
the  rush  to  develop  this  and  other  emerging  technologies  is  understandable  and  irresistible,  at 
least  in  today's  world.  One  possible  defense  for  our  pursuit,  apart  from  self-interested  reasons, 
is  that  we  (the  US)  want  to  ensure  we  develop  these  commanding  technologies  first,  after  which 
we  would  have  more  leverage  to  stop  the  proliferation  of  the  same;  further,  because  we  occupy 
the  higher  moral  ground,  it  would  be  most  responsible  for  the  US  to  develop  the  technologies 
first. 

The  problem,  of  course,  is  that  every  nation  thinks  of  itself  as  moral  or  'doing  the  right  thing',  so 
it  would  be  difficult  to  objectively  assign  a  moral  imperative  to  any  given  nation,  including  the 
US.  Solving  this  problem,  then,  would  seem  to  require  additional  legal  and  ethical  theorizing, 
likely  resulting  in  new  international  treaties  and  amendments  to  the  Laws  of  War. 

3.  Space  race.  As  on  earth,  autonomous  robots  may  hold  many  benefits  for  space  exploration 
[Jonsson  et  al.,  2007).  Proliferation  also  has  significant  financial  and  environmental  costs, 
particularly  if  military  robotics  technology  is  developed  for  outer  space.  First,  launch  costs  are 
still  astronomical,  costing  thousands  of  dollars  per  pound  to  put  an  object  Into  low  Earth  orbit, 
and  several  times  more  per  pound  for  geostationary  orbit  (not  to  mention  periodic  replacement 
costs  and  in-orbit  repairs).  An  unlikely  'star  wars'  scenario  aside— which  would  create  countless 
pieces  of  space  debris  that  would  need  to  be  tracked  and  threaten  communications  satellites 
and  so  on— even  using  robots  for  research  purposes,  e.g.,  to  explore  and  develop  moons  and 
other  planets,  may  spark  another  space  race  given  the  military  advantages  of  securing  the 
ultimate  high  ground.  This  not  only  opens  up  outer  space  for  militarization,  which  the  world's 
nations  have  largely  resisted,  but  diverts  limited  resources  that  could  make  more  valuable 
contributions  elsewhere. 

4.  Technology  dependency.  The  possibility  that  we  might  become  dependent  or  addicted  to  our 
technologies  has  been  raised  throughout  the  history  of  technology  and  even  with  respect  to 
robotics.  Today,  ethicists  worry  that  we  may  become  so  reliant  on,  for  instance,  robots  for 
difficult  surgery  that  humans  will  start  losing  that  life-saving  skill  and  knowledge;  or  that  we 
become  so  reliant  on  robots  for  basic,  arduous  labor  that  our  economy  Is  somehow  impacted 
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and  we  forget  some  of  those  techniques  (Veruggio,  2007).  In  the  military;  some  soldiers  already 
report  being  attached  to  the  robot  that  saved  their  lives  [Garreau,  2007]. 

As  a  general  objection  to  technology,  this  concern  does  not  seem  to  have  much  force,  since  the 
benefits  of  the  technology  in  question  often  outweigh  any  losses.  For  Instance,  our  ability  to 
perform  mathematical  calculations  may  have  suffered  somewhat  given  the  inventions  of  the 
calculator  and  spreadsheets,  but  we  would  rather  keep  those  tools  even  at  that  expense. 
Certainly,  it  is  a  possible  hypothetical  or  future  scenario  that,  after  relying  on  robots  to  perform 
all  our  critical  surgeries,  some  event— say,  a  terrorist  attack  or  massive  electromagnetic  pulse— 
could  interrupt  an  area's  power  supply,  disabling  our  machines  and  leaving  no  one  to  perform 
the  surgery  (because  we  forgot  how  and  have  not  trained  surgeons  on  those  procedures,  since 
robots  were  able  to  do  it  better).  But  as  abilities  enhanced  by  technology,  such  as  performing 
numeric  calculations,  have  not  entirely  disappeared  from  a  population  or  even  to  a  life- 
impacting  degree  in  individuals,  it  is  unclear  why  we  would  expect  something  as  artful  as  brain  or 
heart  surgery  to  be  largely  lost.  Similarly,  In  the  case  of  relying  on  robots  for  manual  labor, 
technology  dependency  would  not  erase  our  ability  to,  say,  dig  holes  to  plant  trees  to  any 
impacting  degree. 

5.  Civil  security  and  privacy.  Defense  technologies  often  turn  into  public  or  consumer  technologies, 
as  we  previously  pointed  out.  So  a  natural  step  In  the  evolution  of  military  robots  would  seem  to 
be  their  incarnation  as  civil  security  robots;  they  might  guard  corporate  buildings,  control 
crowds,  and  even  chase  down  criminals.  Many  of  the  same  concerns  discussed  above— such  as 
technical  challenges  and  questions  of  responsibility— would  also  become  larger  societal 
concerns:  if  a  robot  unintentionally  (meaning  that  no  human  intentionally  programmed  it  to  ever 
cJo  so)  kills  a  small  child,  whether  by  accident  (run  over)  or  mistake  (identification  error),  it  will 
likely  have  greater  repercussions  than  a  robot  that  unintentionally  kills  a  non-combatant  in  some 
faraway  conflict.  Therefore,  there  is  increased  urgency  to  address  these  military  issues  that  may 
spill  over  into  the  public  domain. 

And  while  we  take  it  that  soldiers,  as  government  property,  have  significantly  decreased  privacy 
expectations  and  rights,  the  same  is  not  true  of  the  public  at  large.  If  and  when  robots  are  used 
more  in  society,  and  the  robots  are  likely  to  be  networked,  concerns  about  illegal  monitoring  and 
surveillance— privacy  violations— may  again  surface,  as  they  have  with  most  other  modern 
technologies,  from  DNA  testing  to  genome  sequencing  to  communications-monitoring  software 
to  nanotechnology.  This  raises  the  question  of  what  kind  of  consent  we  need  from  the  public 
before  deploying  these  technologies  in  society. 


7.6  Other  and  Future  Challenges 
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1.  Co-opting  of  ethics  effort  by  military  for  justification.  A  possible  challenge  that  does  not  fit 
neatly  into  any  of  the  above  categories  is  the  following  political  concern.  Defense  organizations 
may  be  aware  (now)  of  the  above  concerns,  but  they  may  still  not  choose  to  address  the  issues 
to  mitigate  risk  by  absolving  themselves  of  this  responsibility:  they  may  simply  point  to  ethicists 
and  robot  scientists  working  on  related  issues  as  justification  for  proceeding  ahead  without  any 
real  plan  to  address  at  least  some  of  these  risks  [Sharkey,  2007b]. 

This  is  an  interesting  meto-issue  for  robot  ethics,  i.e.,  it  is  about  the  study  and  aims  of  robot 
ethics  and  not  so  much  about  an  issue  directly  related  to  the  use  of  autonomous  robots.  While 
it  is  certainly  a  possibility  that  organizations  may  only  pay  'lip-service'  to  the  project  of  robot 
ethics  to  appease  critics  and  watchdogs,  it  does  not  take  much  enlightenment  or  foresight  to  see 
actual,  real-world  benefits  from  earnestly  addressing  these  challenges.  Further,  we  might 
measure  the  commitment  that  organizations  have  to  robot  ethics  by  the  funding  levels  for  such 
research.  And  it  would  be  readily  apparent  if,  for  instance,  defense  organizations  ignored  the 
counsel  and  recommendations  of  experts  engaged  in  the  field.  This  is  to  say  that  co-opting  is  a 
relatively  transparent  activity  to  identify,  although  the  point  is  more  that  it  could  be  too  late  (for 
those  harmed  or  society  in  general)  by  then. 

2.  Robot  rights.  For  now,  robots  are  seen  as  merely  a  tool  that  humans  use,  morally  no  different 
(except  in  financial  value)  than  a  hammer  or  a  rifle — their  only  value  is  instrumental,  as  a  means 
to  our  ends.  But  as  robots  begin  to  assume  aspects  of  human  decision-making  capabilities,  the 
question  may  arise  of  their  intrinsic  value:  do  they  deserve  moral  consideration  of  their  own 
(beyond  their  financial  or  tactical  value),  and  at  what  point  in  their  evolution  will  they  achieve 
this  intrinsic  value  (as  human  lives  seem  to  have)?  When  they  become  Kantian  autonomous 
agents,  making  their  own  goals  for  themselves?  Or  would  intrinsic  value  also  require 
consciousness  and  emotions? 

Some  technologists  have  suggested  that,  by  2029,  robots  will  demand  equal  treatment  before 
the  law  with  humans— and  believe  that  this  demand  will  be  granted  [e.g.,  Kurzweil,  1999].  The 
only  guarantee  of  avoiding  this  outcome  appears  to  be  a  prohibition  on  programming  robots 
with  anything  other  than  a  'slave  morality',  i.e.,  simply  not  allowing  a  Kantian-autonomous  robot 
to  ever  be  programmed  or  built  (though  such  bans,  especially  when  applied  internationally,  have 
been  notoriously  difficult  to  enforce).  It  will  require  careful  consideration  in  the  future  as  to 
whether  such  a  prohibition  should  ever  be  lifted.  Fortunately,  even  'technological  optimists', 
such  as  Kurzweil,  do  not  expect  this  to  be  an  issue  until  at  least  the  2020s. 

Thus  far,  we  have  not  discussed  the  possibility  of  giving  rights  to  robots,  not  so  much  that  it  Is 
farfetched  to  do  so  (e.g.,  we  give  rights  to  non-living  entities  such  as  corporations)  or  to  consider 
them  as  persons  (philosophically-speaking;  e.g.,  again  corporations  or  ships  or  some  animals 
such  as  dolphins),  but  that  the  prerequisites  for  rights  seem  to  require  advanced  software  or 
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■artificial  intelligence  that  is  not  quite  within  our  foreseeable  grasp.  Specifically,  if  our  notion  of 
aersonhood  specifies  that  only  persons  can  be  afforded  rights  and  that  persons  must  have  free 
will  or  the  capacity  for  free  will,  then  it  is  unclear  whether  we  will  ever  develop  technologies 
capable  of  giving  free  will  or  full  autonomy  to  machines,  and,  Indeed,  we  don't  even  know 
whether  any  other  biological  species  will  ever  have  or  is  now  capable  of  such  full  autonomy; 
thus,  we  do  not  want  to  dwell  on  such  a  speculative  issue  here.  That  said,  we  will  leave  open  the 
possibility  that  we  may  someday  want  or  be  logically  required  to  give  rights  to  robots  [e.g., 
Kurzweil,  1999],  but  much  more  investigation  is  needed  on  the  issue. 

3.  The  precautionary  principle.  Given  the  above  laundry  list  of  concerns,  some  may  advocate 
following  a  precautionary  principle  in  robotics  research— to  slow  or  halt  work  until  we  have 
mitigated  or  addressed  possible  catastrophic  risks— as  critics  have  done  for  other  technologies, 
such  as  bio-  and  nanotechnologies.  For  instance,  those  fearful  of  'Terminator'  scenarios  where 
machines  turn  against  us  lesser  humans,  current  research  in  autonomous  robotics  may 
represent  a  path  towards  possible,  perhaps  likely,  disaster;  thus  a  cautious,  prudent  approach 
would  be  to  ban  or  at  least  significantly  slow  down  research  until  we  can  sufficiently  think  about 
these  issues  before  technology  overtakes  ethics.  While  we  believe  that  a  precautionary  principle 
may  be  the  appropriate  course  of  action  for  some  technology  cases,  many  of  the  issues 
discussed  above  do  not  appear  imminent  enough  to  warrant  a  research  moratorium  or  delay, 
just  more  investigation  which  may  be  sufficiently  conducted  in  parallel  to  efforts  to  develop 
advanced  robotics. 

Furthermore,  a  cautionary  approach  in  the  development  of  advanced  systems  is  inherently  in 
tension  with  both  the  approaches  taken  by  the  scientists  and  engineers  developing  robots  and 
with  the  outlook  of  military  planners,  rapidly  searching  for  more  effective  tools  for  the  task  of 
waging  war.  We  will  again  leave  open  the  possibility  that  someday  we  may  have  to  seriously 
consider  the  role  of  the  precautionary  principle  in  robotics,  but  that  day  appears  to  be  in  the 
distant  horizon  and  does  not  demand  an  extensive  discussion  here. 
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7.7  Further  and  Related  Investigations  Needed 


Again,  we  do  not  intend  the  above  to  capture  all  possible  issues  related  to  autonomous  military 
robotics.  Certainly,  new  issues  will  emerge  depending  on  how  the  technology  and  intended  uses 
develop.  In  preceding  sections,  we  have  started  to  address  what  we  seemed  to  be  the  most  urgent 
and  important  issues  to  resolve  first,  especially  as  related  to  responsibility,  risk,  and  the  ability  of 
robots  to  discriminate  among  targets.  This  is  only  the  beginning  of  a  dialogue  in  robot  ethics  and 
merits  further  investigations. 

Moreover,  our  discussion  here  may  be  helpful  in  informing  ethics  research  related  to  non-military 
robots,  such  as  security,  labor,  and  sex  robots  previously  mentioned  in  the  public  domain.  For 
instance,  robots  are  already  being  used  to  care  for  the  elderly,  but  are  we  merely  pawning  off  our 
obligations  to  care  for  the  elderly  to  machines  who  may  be  unable  to  provide  the  emotional  content 
that  seems  to  be  needed  in  human  relationships  (even  though  there  are  significant  advances  in 
enabling  robots  to  display  'emotions')?  What  are  the  benefits  and  risks  of  using  robots  as  teachers, 
domestic  help,  or  even  as  researchers,  e.g.,  exploring  difficult  and  alien  environments?  Do  robotic 
planes,  trains,  and  automobiles  pose  any  special  issues?  These  and  other  questions  will  need  to  be 
addressed;  and  as  is  often  the  case  with  public  technologies,  they  have  their  roots  in  military 
innovations,  so  we  may  have  a  separate  but  related  responsibility  to  begin  looking  ahead  to  these 
non-military  questions  as  well. 
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8.  Conclusions 


''We  can  only  see  a  short  distance  ahead,  but  we  can  see  plenty  there  that  needs  to 
be  done/'— Alan  Turing  [1950,  p.  460] 


There  are  many  paths  one  may  take  in  examining  issues  of  risk  and  ethics  arising  from  advanced 
military  robotics.  We  initiate  several  lines  of  inquiry  in  this  preliminary  report,  as  follows. 

In  section  1,  we  begin  by  building  the  case  for  'robot  ethics.'  While  there  are  substantial  benefits  to 
be  gained  from  the  use  of  military  robots,  there  are  also  many  opportunities  for  these  machines  to 
act  inappropriately,  especially  as  they  are  given  greater  degrees  of  autonomy  (for  quicker,  more 
efficient,  and  more  accurate  decision-making,  and  if  they  are  to  truly  replace  human  soldiers).  The 
need  for  robot  ethics  becomes  more  urgent  when  we  consider  pressures  driving  the  market  for 
military  robotics  as  well  as  long-standing  public  skepticism  that  lives  in  popular  culture. 

In  section  2,  we  lay  the  foundation  for  a  robot-ethics  investigation  by  presenting  a  wide  range  of 
military  robots— ground,  aerial,  and  marine— currently  In  use  and  predicted  for  the  future.  While 
most  of  these  robots  today  are  semi-autonomous  (e.g.,  the  US  Air  Force's  Predator),  some 
apparently-fully  autonomous  systems  are  emerging  (e.g.,  the  US  Navy's  Phalanx  CIWS)  though  used 
in  a  very  limited,  last-resort  context.  From  this,  we  can  already  see  ethical  questions  emerge, 
especially  related  to  the  ability  to  discriminate  combatants  from  non-combatants  and  the 
circumstances  under  which  robots  can  make  attack  decisions  on  their  own.  We  return  to  these 
questions  In  subsequent  sections,  particularly  section  7. 

In  section  3,  we  look  at  behavioral  frameworks  that  might  ensure  ethical  actions  in  robots.  It  is 
natuMi  to  consider  various  programming  approaches,  since  robots  are  related  to  our  personal  and 
business  corr  puter  systems  today  that  also  depend  on  programmed  instructions.  We  also  recognize 
the  forward-looking  nature  of  our  discussions  here,  given  that  the  more-sophisticated  programming 
abilities  needed  to  build  truly  autonomous  robotics  are  still  under  development. 

We  first  discuss  the  traditional  approach  of  top-down  programming,  i.e.,  establishing  general  rules 
that  the  robot  would  follow.  A  clear  example  is  a  deontological  approach,  such  as  using  Kant's 
Categorical  Imperative  or  Asimov's  Laws  of  Robotics.  However,  a  rigid  set  of  rules  is  likely  not  robust 
enough  to  arrive  at  the  correct  action  or  decision  in  enough  cases,  particularly  in  unforeseen  and 
complex  scenarios.  This  suggests  that  we  also  need  to  attend  to  the  'rightness'  of  the  result  itself. 
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not  just  to  the  rules.  But  even  if  we  acknowledge  that  consequences  matter,  there  are  other 
challenges  raised  by  adopting  a  consequentialist/utilitarian  approach,  such  as  the  impracticality  of 
calculating  and  weighing  all  possible  results,  both  near  and  far  term,  and  the  (strong)  possibility  of 
countenancing  some  intuitively-wrong  action. 

Given  the  apparent  limitations  of  top-down  programming,  we  then  examine  bottom-up  approaches, 
inspired  by  biological  evolution  and  human  development.  However,  a  key  challenge  is  that  bottom- 
up  systems  work  best  when  they  are  directed  at  achieving  one  clear  goal,  but  military  robots  often 
operate  in  dynamic  environments  in  which  available  information  is  confusing  or  incomplete.  That  is, 
even  if  moral  calculation  is  not  an  issue,  there  still  remains  the  large  problem  of  moral  psychology, 
i.e.,  how  to  develop  robots  that  embody  the  right  tendencies  in  their  reactions  to  the  world  and 
other  agents  in  that  world,  particularly  when  the  robots  are  confronted  with  a  novel  situation  in 
which  they  cannot  rely  on  experience. 

Moral  reasoning  by  humans,  however,  is  not  limited  to  exclusively  a  top-down  or  bottom-up 
approach;  rather,  we  often  use  both  strategies  of  rule-following  and  experience.  (Nonetheless,  it  is 
useful  to  evaluate  both  programming  approaches  separately  to  identify  their  benefits  and 
challenges.)  Therefore,  we  consider  a  hybrid  approach  of  virtue  ethics  for  constructing  ethical 
autonomous  robots.  This  approach  is  concerned  with  the  development  of  moral  character;  in  the 
military  case,  with  promoting  the  ideal  character  traits  of  a  warfighter,  i.e.,  a  'warrior  code  of  ethics' 
as  its  virtues. 

In  section  4,  we  look  at  considerations  in  programming  the  Laws  of  War  (LOW)  and  Rules  of 
Engagement  (ROE),  which  may  differ  from  mission  to  mission,  into  a  robot.  No  matter  which 
programming  approach  is  adopted,  we  at  least  would  want  to  the  robot  to  obey  the  LOW  and  ROE, 
and  this  might  serve  as  a  proxy  for  full-fledged  morality  until  we  have  the  capability  to  program  a 
robot  with  the  latter.  Such  an  approach  has  several  advantages,  including:  (1)  any  problems  from 
moral  relativism/particularism  or  other  problems  with  general  ethical  principles  are  avoided;  and  (2) 
the  relationship  of  morality  to  legality— a  minefield  for  ethics— is  likewise  largely  avoided,  since  the 
LOW  and  ROE  make  clear  what  actions  are  legal  and  illegal  for  robots,  which  serves  as  a  reasonable 
approximation  to  the  moral-immoral  distinction. 

Our  discussion  of  the  LOW  and  ROE,  then,  delves  Into  their  underlying  foundation  in  just-war  theory, 
particularly  jus  ad  bellum  (moral  justification  for  entering  war)  and  jus  in  bello  (just  and  unjust 
actions  In  the  prosecution  of  a  war).  We  also  examine  ethical  challenges  to  just-war  theory  as 
related  to  military  robotics:  Some  have  objected  to  the  use  of  military  robotics  on  the  grounds  that  it 
makes  easier  the  decision  to  enter  war,  in  apparent  violation  of  jus  ad  bellum;  and  we  again  see  that 
the  technical  ability  to  properly  discriminate  against  targets,  as  required  by  jus  in  bello,  Is  a  concern. 
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In  section  5,  we  attend  to  the  recurring  possibility  of  accidental  or  unauthorized  harm  caused  by 
robots;  who  would  be  responsible  ultimately  for  those  mishaps?  We  look  at  the  issue  through  the 
lens  of  legal  liability,  both  when  robots  are  considered  as  merely  products  and  when,  as  they  are 
given  more  autonomy,  they  might  be  treated  as  legal  agents,  e.g.,  as  legal  quasi-persons  such  as 
children  are  "egarded  by  the  law.  In  the  latter  case,  it  is  not  clear  how  we  would  punish  robots  for 
their  inappropriate  actions. 

In  section  6,  still  attending  to  the  possibility  of  unintended  or  unforeseen  harm  committed  by  a 
robot,  we  broaden  our  discussion  by  looking  at  how  we  might  think  about  general  risks  posed  by  the 
machines  and  their  acceptability.  We  offer  a  preliminary  framework  for  a  technology  risk 
assessment,  which  includes  the  key  factors  of  consent,  informed  consent,  affected  population, 
seriousness,  and  probability.  This  assessment  highlights  further  the  need  for  a  lengthy  period  of 
rigorous  testing  and  gradual  rollout  (crawl-walk-run  approach)  as  a  moral  minimum  for  the 
responsible  deployment  of  autonomous  robots,  especially  by  the  military. 

Finally,  in  section  7,  we  bring  together  a  full  range  of  issues  raised  throughout  our  examination,  as 
well  as  some  new  issues,  that  must  be  recognized  in  any  comprehensive  assessment  of  risks  from 
military  robotics.  These  challenges  fall  into  categories  related  to  law,  just-war  theory,  technical 
capabilities,  human-robot  interactions,  general  society,  and  other  and  future  issues.  For  instance, 
we  discuss  such  issues  as: 

•  If  a  military  robot  refuses  an  order,  e.g.,  if  it  has  better  situational  awareness,  then  who 
would  be  responsible  for  its  subsequent  actions? 

•  How  stringent  should  we  take  the  generally-accepted  'eyes  on  target'  requirement,  i.e., 
under  what  circumstances  might  we  allow  robots  to  make  attack  decisions  on  their  own? 

•  What  precautions  ought  to  be  taken  to  prevent  robots  from  running  amok  or  turning  against 
our  own  side,  whether  through  malfunction,  programming  error,  or  capture  and  hacking? 

•  To  the  extent  that  military  robots  can  help  reduce  instances  of  war  crimes,  what  is  the  harm 
that  may  arise  if  the  robots  also  unintentionally  erode  squad  cohesion  given  their  role  as  an 
'outside'  observer? 

•  Should  robots  be  programmed  to  defend  themselves— contrary  to  Arkin's  position— given 
that  they  represent  costly  assets? 

•  Would  using  robots  be  counterproductive  to  winning  the  hearts  and  minds  of  occupied 
populations  or  result  In  more  desperate  terrorist-tactics  given  an  increasing  asymmetry  in 
warfare? 

From  the  preceding  investigation,  we  can  draw  some  general  and  preliminary  conclusions,  including 
some  future  work  needed: 
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1.  Creating  autonomous  military  robots  that  can  act  at  least  as  ethically  as  human  soldiers 
appears  to  be  a  sensible  goal,  at  least  for  the  foreseeable  future  and  in  contrast  to  a  greater 
demand  of  a  perfectly-ethical  robot.  However,  there  are  still  daunting  challenges  in  meeting 
even  this  relatively-low  standard,  such  as  the  key  difficulty  of  programming  a  robot  to 
reliably  distinguish  enemy  combatants  from  non-combatants,  as  required  by  the  Laws  of 
War  and  most  Rules  of  Engagement. 

2.  While  a  faster  introduction  of  robots  in  military  affairs  may  save  more  lives  of  human 
soldiers  and  reduce  war  crimes  committed,  we  must  be  careful  to  not  unduly  rush  the 
process.  Much  different  than  rushing  technology  products  to  commercial  markets,  design 
and  programming  bugs  in  military  robotics  would  likely  have  serious,  fatal  consequences. 
Therefore,  a  rigorous  testing  phase  of  robots  is  critical,  as  well  as  a  thorough  study  of  related 
policy  issues,  e.g.,  how  the  US  Federal  Aviation  Administration  (FAA)  handles  UAVs  flying  in 
our  domestic  National  Airspace  System  (which  we  have  not  addressed  here). 

3.  Understandably,  much  ongoing  work  In  military  robotics  is  likely  shrouded  in  secrecy;  but  a 
balance  between  national  security  and  public  disclosure  needs  to  be  maintained  in  order  to 
help  accurately  anticipate  and  address  issues  of  risk  or  other  societal  concerns.  For  instance, 
there  is  little  information  on  US  military  plans  to  deploy  robots  in  space,  yet  this  seems  to  be 
a  highly  strategic  area  in  which  robots  can  lend  tremendous  value;  however,  there  are 
Important  environmental  and  political  sensitivities  that  would  surround  such  a  program. 

4.  Serious  conceptual  challenges  exist  with  the  two  primary  programming  approaches  today: 
top-down  (e.g.,  rule-following)  and  bottom-up  (e.g.,  machine  learning).  Thus  a  hybrid 
approach  should  be  considered  in  creating  a  behavioral  framework.  To  this  end,  we  need  to 
a  clear  understanding  of  what  a  'warrior  code  of  ethics'  might  entail.  If  we  take  a  virtue- 
ethics  approach  In  programming. 

5.  In  the  meantime,  as  we  wait  for  technology  to  sufficiently  advance  in  order  to  create  a 
workable  behavioral  framework.  It  may  be  an  acceptable  proxy  to  program  robots  to  comply 
with  the  Law  s  of  War  and  appropriate  Rules  of  Engagement.  However,  this  too  is  much 
easier  said  than  done,  and  at  least  the  technical  challenge  of  proper  discrimination  would 
persist  and  require  resolution. 

6.  Given  technical  limitations,  such  as  programming  a  robot  with  the  ability  to  sufficiently 
discriminate  against  valid  and  invalid  targets,  we  expect  that  accidents  will  continue  to 
occur,  which  raise  the  question  of  legal  responsibility.  More  work  needs  to  be  done  to 
clarify  the  chain  of  responsibility  in  both  military  and  civilian  contexts.  Product  liability  laws 
are  informative  but  untested  as  they  relate  to  robotics  with  any  significant  degree  of 
autonomy. 
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7.  Assessing  technological  risks,  whether  through  the  basic  framework  we  offer  in  section  6  or 
some  other  framework,  depend  on  identifying  potential  issues  in  risk  and  ethics.  These 
issues  vary  from:  foundational  questions  of  whether  autonomous  robotics  can  be  legally  and 
morally  deployed  in  the  first  place,  to  theoretical  questions  about  adopting  precautionary 
approaches,  to  forward-looking  questions  about  giving  rights  to  truly  autonomous  robots. 
These  discussions  need  to  be  more  fully  developed  and  expanded. 

3.  Specifically,  the  challenge  of  creating  a  robot  that  can  properly  discriminate  among  targets  is 
one  of  the  most  urgent,  particularly  If  one  believes  that  the  (increased)  deployment  of  war 
robots  is  inevitable.  While  this  is  a  technical  challenge  and  resolvable  depending  on 
advances  in  programming  and  Al,  there  are  some  workaround  policy  solutions  that  can  be 
anticipated  and  further  explored,  such  as:  limiting  deployment  of  lethal  robots  to  only  inside 
a  'kill  box';  or  designing  a  robot  to  target  only  other  machines  or  weapons;  or  not  giving 
robots  a  self-defense  mechanism  so  that  they  may  act  more  conservatively  to  prevent;  or 
even  creating  robots  with  only  non-lethal  or  less-than-lethal  strike  capabilities,  at  least 
initially  until  they  are  proven  to  be  reliable. 

These  and  other  considerations  warrant  further,  more  detailed  investigations  in  military  robotics  and 
Issues  of  design,  risk,  and  ethics.  Such  interdisciplinary  investigations  will  require  collaboration 
among  policymakers  and  analysts,  roboticists,  ethicists,  sociologists,  psychologists,  and  others, 
internationally  and  Including  the  general  public  as  a  key  stakeholder.  And  this  work  has  the  potential 
to  be  as  broad  as  other  fields  in  science  and  society,  such  as  bioethics  or  computer  ethics. 

The  use  of  military  robots  represents  a  new  era  In  warfare,  perhaps  more  so  than  crossbows, 
airplanes,  nuclear  weapons,  and  other  innovations  have  previously.  Robots  are  not  merely  another 
asset  In  the  military  toolbox,  but  they  are  meant  to  also  replace  human  soldiers,  especially  in  'dull, 
dirty,  and  dangerous'  jobs.  As  such,  they  raise  novel  ethical  and  social  questions  that  we  should 
confront  as  far  in  advance  as  possible— particularly  before  irrational  public  fears  or  accidents  arising 
from  military  robotics  derail  research  progress  and  national  security  interests. 
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Appendix  A:  Definitions 


While  we  do  not  want  to  be  entangled  with  debating  precise  definitions  in  this  report,  it  nevertheless 
would  be  useful  to  give  more  detailed  explanations  of  our  key  terms— namely  'robot',  'autonomy', 
and  'ethics'— to  ensure  a  common  understanding  from  the  start: 


A.l  Robot 


Before  we  offer  a  working  definition  of  a  robot,  let  us  note  some  historical  origins:  In  1921,  the  world 
was  introduced  to  modern  concept  of  a  robot  in  the  popular  play  R.U.R.  (or  Rossum's  Universal 
Robots)  by  Czech  author  Karel  Capek.  The  dystopian  play  featured  factory-built,  artificial  people, 
who  can  be  mistaken  as  humans,  called  robots— whose  namesake  is  derived  from  the  Czech  word 
'robota'  which  means  'drudgery'  or  'servitude'  or  'labor',  and  these  engineered  slaves  ultimately 
rebel  against  their  human  masters. 

Capek's  robots  were  biological  based  and  more  akin  to  the  resurrected  man-creature  in  Mary 
Shelley's  Frankenstein  or  the  replicants  of  Ridley  Scott's  Blade  Runner  than  to  the  modern  fusion  of 
computer  and  machine,  popularized  by  science-fiction  author  Isaac  Asimov  and  others.  Therefore, 
the  idea  that  robots  are  electromechanical  is  not  part  of  the  original  conception  of  robots;  nor  does 
it  seem  to  be  an  essential  feature,  since  we  can  imagine  advances  in  genetic  engineering  and 
synthetic  biology  to  some  day  enable  us  to  create  biological-based  artificial  creatures  that  function 
as  today's  robots  do  and  can  be  called  'robots'  (or  called  something  else  if  such  developments  cause 
us  to  evolve  our  terminology,  as  'robot'  had  replaced  older  words  such  as  'automaton'  and 
'android').  That  said,  we  will  concern  ourselves  here  primarily  with  electromechanical  machines, 
though  we  will  leave  open  the  possibility  of  biological  and  virtual  machines  or  creations  as  robots. 

Further,  though  the  original  notion  of  a  robot  is  tied  with  automation  of  work,  we  are  more 
interested  in  how  the  definition  of  robot  differentiates  a  robot  from  a  garden-variety,  mere  machine. 
That  is,  our  definition  is  not  meant  to  help  elucidate  the  difference  between  a  robot  and  automation 
or  work,  rather  to  help  explain  why  objects  such  as  a  laptop  computer  or  a  coffee  machine  do  not 
count  as  robots. 

To  the  definition  now,  in  Its  most  basic  sense,  we  define  'robot'  as  a  machine  that  senses,  thinks,  and 
acts:  "Thus  a  robot  must  have  sensors,  processing  ability  that  emulates  some  aspects  of  cognition, 
and  actuators.  Sensors  are  needed  to  obtain  information  from  the  environment.  Reactive  behaviors 
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(like  the  stretch  reflex  in  humans)  do  not  require  any  deep  cognitive  ability,  but  on-board  intelligence 
is  necessary  if  the  robot  is  to  perform  significant  tasks  autonomously,  and  actuation  is  needed  to 
enable  the  robot  to  exert  forces  upon  the  environment.  Generally,  these  forces  will  result  in  motion 
of  the  entire  robot  or  one  of  its  elements  (such  as  an  arm,  a  leg,  or  a  wheel)''  [Bekey,  2005]. 

For  all  practical  purposes  today,  this  means  that  a  robot  is  essentially  a  computer  with  sensory  inputs 
(that  do  not  require  direct  and  intentional  human  action,  such  as  required  by  a  keyboard  or 
touchpad;  i.ei.,  it  can  direct  itself  given  certain  environmental  inputs)  and  non-digital  output  (i.e., 
more  than  manipulation  of  data  or  pixels  or  even  sending  a  file  to  printer,  but  an  ability  to  move 
some  part  of  itself  in  order  to  manipulate  real-world  objects).  This  is  neither  a  precise  definition  nor 
description,  and  it  certainly  needs  to  be  refined;  but  it  at  least  begins  to  meet  our  needs  for  a  general 
understanding  of  what  counts  and  what  does  not  count  as  a  robot. 

A  standard,  more  exact  definition,  however,  proves  elusive,  as  perhaps  evidenced  by  the  fact  that  no 
major  robotics  organization  to  our  knowledge— including  Robotic  Industries  Association,  IEEE  and  its 
Robotics  &  Automation  Society,  European  Robotics  Research  Network,  Japan  Robot  Association, 
Australian  Robotics  &  Automation  Association,  and  others— provides  a  clear  definition  of  the  term 
on  their  resoective  sites  or  publications,  as  far  as  we  can  tell.  Some  organizations,  such  as 
International  Federation  of  Robotics,  follow  the  definition  given  by  the  International  Organization  for 
Standardization  (ISO)  for  monipuloting  industrial  robots:  "an  automatically  controlled, 
reprogrammable,  multipurpose,  manipulator  programmable  in  three  or  more  axes,  which  may  be 
either  fixed  in  place  or  mobile  for  use  in  industrial  automation  applications"  [International 
Federation  of  Robotics,  2008].  But  this  is  far  from  an  adequate  definition  for  a  generic  robot,  and  no 
ISO  cefinition  for  such  a  robot  has  been  devised,  to  our  knowledge. 

In  a  military  context,  we  have  a  more  useful  understanding  from  the  US  Department  of  Defense's 
(DoD)  definition  of  an  'unmanned  vehicle'  (though  some  of  these  might  not  properly  be  robots,  at 
least  under  our  working  definition):  "A  powered  vehicle  that  does  not  carry  a  human  operator,  can 
be  operated  autonomously  or  remotely,  can  be  expendable  or  recoverable,  and  can  carry  a  lethal  or 
non-lethal  payload.  Ballistic  or  semi-ballistic  vehicles,  cruise  missiles,  artillery  projectiles,  torpedoes, 
mines,  satellites,  and  unattended  sensors  (with  no  form  of  propulsion)  are  not  considered  unmanned 
vehicles.  Unmanned  vehicles  are  the  primary  component  of  unmanned  systems"  [US  Department  of 
Defense,  2007,  p.  1]. 

We  take  'vehicle'  to  mean  a  mobile,  maneuverable  machine  such  as  a  car,  boat,  or  airplane,  but  in 
our  analysis,  a  robot  need  not  be  mobile  (though  it  seems  most  will  be  in  military  applications).  Yet 
some  degree  of  mobility  is  an  essential  feature  of  a  robot,  as  we  mentioned  In  our  first  definition  of  a 
robot  above;  for  instance,  a  robot  can  be  a  fixed  manufacturing  machine  with  movable  arms  or  an 
immobile  sentry  robot  with  swiveling  gun  turrets.  The  mobility  requirement  here  has  less  to  do  with 
moving  from  one  physical  location  to  another  (although  most  robots  can  and  will  do  this)  but  more 
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with  the  ability  to  interact  with  and  manipulate  the  external,  physical  world  to  some  meaningful 
degree.  This  requirement  then  differentiates  a  robot  from,  say,  a  computer  with  environmental 
sensors  but  that  can  only  run  software  programs  and  not  exert  a  sufficient  amount  of  force  on  the 
outside  world  (beyond  spitting  out  pages  of  paper  or  opening  its  CD  player  door). 

Relatedly,  the  concept  that  the  machine  is  powered  is  needed  in  a  sensible  definition  of  a  robot. 
Though  it  is  taken  for  granted  that  all  machines  operate  under  some  power,  especially  where 
mobility  and  information  processing  is  required,  we  want  to  rule  out  'dumb'  machines  that  are  not 
internally  driven  but  nonetheless  seem  to  sense,  think,  and  act.  For  instance,  a  small  sensor  may  be 
designed  to  be  carried  by  wind  or  water  and  mechanically  perform  some  action  under  certain 
conditions  (such  as  release  a  payload  when  a  thermal,  chemical,  or  gyroscopic  switch  is  tripped): 
such  a  machine  appears  to  sense,  act,  and  think  (to  the  extent  it  performs  an  action  under  the  right 
conditions,  similar  to  a  mechanical  calculator  of  the  early  twentieth  century),  yet  we  would  resist 
calling  it  a  robot,  though  it  would  still  be  considered  a  machine,  i.e.,  robots  belong  to  a  subset  of 
machines.  This  is  not  to  say  that  very  small  robots  cannot  be  carried  by  wind  or  waves,  but  they 
would  also  need  to  convert  or  otherwise  use  that  energy,  or  use  some  other  power,  to 
independently  move  itself  or  some  part  of  the  machine.  Thus,  our  definition  of  a  robot  should 
include  the  notion  of  internal  or  self-directed  power  (e.g.,  electricity  generated  by  a  battery  or 
harnessed  from  solar  or  wave  energy),  as  well  as  the  existence  of  something  to  be  powered  (e.g.,  a 
computer  processing  chip  or  payload-release  mechanism). 

However,  the  DoD  definition  needs  to  be  modified  for  our  use  in  this  report:  It  seems  to  be  overly 
broad  to  include  fully-remote-controlled  machines  as  robots,  since  many  children's  toys  would 
qualify  as  robots,  such  as  a  toy  car  tethered  or  wirelessly  connected  to  a  control  knob  (though  a  few 
toys,  such  as  AIBO^“  or  Pleo^“  or  Robosapien^”,  may  truly  be  robots).  That  is,  most  of  these  toys  do 
not  make  decisions  for  themselves;  they  depend  on  a  human  actor.  Rather,  the  generally-accepted 
idea  of  a  robot  depends  critically  on  the  notion  that  it  has  some  degree  of  autonomy  or  can  'think' 
for  itself,  as  it  makes  decisions  and  acts  upon  the  environment.  Thus,  the  Air  Force's  Predator, 
though  mostly  tele-operated  by  humans,  makes  some  navigational  decisions  on  its  own  and 
therefore  would  count  as  a  robot.  Further,  robots  need  not  be  unmanned,  though  many  are  and  will 
be.  It  Is  conceivable  that  a  robot  may  Indeed  be  partially  autonomous  and  carry  a  human  operator 
who  makes  some  decisions,  so  we  do  not  want  to  rule  such  a  machine  out  in  our  definition.  Indeed, 
beyond  the  distinction  between  a  robot  and  a  mere  machine,  the  line  between  robot  and  human 
may  soon  become  blurred  as  robotic  technologies  are  integrated  with  biological  bodies. 

As  for  the  ISO's  requirements  of  multi-purpose,  reprogrammable,  and  movable  on  three  or  more 
axes,  those  seem  to  be  unnecessarily  limiting  for  a  general  definition  of  a  robot,  though  perhaps 
appropriate  for  the  ISO's  purpose  of  defining  a  manipulating  industrial  robot.  So  we  will  not  include 
those  requirements  in  our  conception  of  a  robot  here,  though  further  investigations  may  warrant 
them.  For  instance,  we  are  leaving  open  the  question  whether  a  robot  needs  to  be  programmable  or 
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reprogrammable,  since  we  may  envision  counterexamples  of  a  disposable,  one-time-use  robotic 
insect  that  is  not  reprogrammable  or  some  autonomous  robot  that  transcends  its  programming. 

Therefore,  our  working  definition  of  a  robot— a  powered  machine  that  (1)  senses,  (2)  thinks  (in  a 
deliberative,  non-mechanical  sense),  and  (3)  acts— appears  defensible  and  comprehensive.  In 
addition  to  the  cases  preciously  discussed,  it  can  rule  out  as  robots  the  following  (current  but 
perhaps  not  future)  types  of  ordnances  and  technologies:  ballistic  or  semi-ballistic  vehicles,  cruise 
missiles,  artillery  projectiles,  torpedoes,  mines,  satellites,  and  unattended  sensors  (with  no  form  of 
propulsion).  However,  a  'smart'  mine,  for  instance,  conceivably  may  be  developed  in  the  future  such 
that  it  can  sense,  think  (i.e.,  discriminate  among  targets),  and  act  (i.e.,  exert  forces  upon  the 
environment,  other  than  self-destruct)  and  therefore  considered  to  be  a  robot.  In  non-military 
contexts,  our  definition  eliminates  mundane  objects,  such  as  coffee  machines  (they  don't  think;  see 
related  discussion  below  about  autonomy)  and  personal  computers  (which,  by  themselves,  don't 
exert  an  influence  on  or  sense  the  external  world  in  a  significant  way,  and  they  require  human 
inputs),  as  roaots. 


A.2  Autonomy 


This  brings  us  to  another  critical  concept  we  need  to  define:  autonomy.  Though  this  task  is  even 
more  difficult  than  the  former,  we  will  offer  less  analysis,  given  that  the  different  conceptions, 
complexity,  and  applications  of  autonomy  are  well  covered  throughout  philosophical  and  legal 
literature  (and  such  discussions  about  the  definition  of  a  robot  has  not  been  nearly  extensively 
covered  in  technical  or  other  literature).®  For  the  purposes  of  this  report,  it  will  suffice  to  initially 
stipulate  'autonomy'  to  be  about  the  capacity  to  operate  in  the  real-world  environment  without  any 
form  of  external  control  for  extended  periods  of  time  [Bekey,  2005),  (But  see  the  refined  definition 
below.) 


This  IS  to  say  that,  in  defining  the  term,  we  are  not  interested  at  this  point  in  issues  traditionally 
linked  to  autonomy,  such  as  the  assignment  of  political  rights  and  moral  responsibility  (as  different 
from  legal  responsibility)  or  even  more  philosophical  issues  related  to  free  will,  moral  agency, 
personhood,  and  whether  machines  can  even  'think'  and  have  intentions  (as  opposed  to  merely 
being  programmed  to  achieve  some  goal)— as  important  as  those  issues  are  in  philosophy,  law,  and 


®  We  v/ant  to  recognize  a  technical  account  of  autonomy,  such  that  autonomy  is  measured  by  the  amount  of  time  it 
takes  lor  a  system  to  refer  or  'check  back'  with  a  human  before  proceeding  with  a  certain  action  [Hew,  2007].  Thus,  a 
landmine  has  infinite  autonomy,  since  it  never  needs  to  refer  back  to  a  human  for  authorization  once  it  has  been 
armed;  and  a  fu  ly  remote-controlled  robot  would  have  no  autonomy,  since  It  is  constantly  referring  back  to  a  human 
(and  Indeed  completely  dependent  on  a  human)  for  instructions.  While  this  may  be  a  useful  account  of  autonomy  in 
some  technical  discussions,  it  does  not  seem  to  be  relevant  to  a  discussion  about  ethics  and  risk,  to  the  extent  that 
such  issues  arise  from  a  system's  ability  to  make  unpredIcted,  unforeseen,  unanticipated,  or  undesirable  choices. 
Further,  from  a  egal  and  ethical  standpoint,  it  seems  to  be  Incoherent  to  ascribe  autonomy  to  unthinking  objects 
such  as  landmines  or  a  toaster. 
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ethics.  Therefore,  in  the  interest  of  simplicity,  we  will  content  ourselves  to  define  and  discuss 
autonomy  in  the  context  of  human-created  machines. 

The  notion  of  autonomy  is  important  to  help  elucidate  the  second  criteria  of  'thinking'  in  our  basic 
working  definition  of  a  robot.  Like  autonomy,  much  controversy  surrounds  our  understanding  of 
'thinking',  especially  whether  it  is  appropriate  to  apply  that  term  to  machines.  By  this  term,  we  do 
not  mean  the  mere  capability  of  information  or  data  processing;  that  would  make  most  of  our 
electronic  devices  into  thinking  things  and  make  the  term  overly  broad.  Rather,  by  'thinking',  we 
mean  to  include  some  degree  of  autonomy  or  decision-making  not  Influenced  by  external 
controllers,  giving  the  machine  an  appearance  of  deliberative  thought,  if  not  the  actual  ability  to 
meaningfully  make  choices.^ 

Thus,  given  our  initial  definition  of  autonomy,  fully  remote-  or  tele-operated  machines  would  not 
count  as  autonomous,  since  they  are  not  operated  without  external  control;  they  cannot  'think'  and 
therefore  cannot  act  for  themselves.  (Again,  tele-operated  vehicles  such  as  the  Air  Force's  Predator 
would  count  as  robots  under  our  working  definition,  because  they  have  some  autonomy,  such  as  in 
navigation,  even  if  they  do  not  make  any  strike  decisions,)  Neither  are  today's  desktop  or  laptop 
computers  autonomous,  since  they  still  require  human  inputs.  Yet  a  problem  with  our  simple 
definition  may  arise:  wouldn't  autonomous  robots  simply  be  sensing  and  moving  computers  that  run 
programs,  like  everyday  computers;  and  through  these  programs,  both  computers  and  robots  can  be 
said  to  be  'externally  controlled'  by  the  programmer  or  team  of  programmers  that  created  the 
program?  That  is  to  say,  the  notion  of  external  control  is  vague  and  begs  for  clarification. 

Let's  retreat  one  step  to  ask  the  following:  might  we  consider  some  computers  as  sem/-autonomous, 
such  as  one  that  runs  a  computer  program  that  enables  an  avatar  (or  virtual-reality  character  or 
persona)  to  run  without  further  external  control,  i,e,,  an  avatar  that  seems  to  act  on  its  own,  as  some 
already  do  now?  Surely,  such  an  avatar  would  be  considered  at  least  semi-autonomous,  at  least  by 
popular  standards,  but  how  do  we  adjust  our  definition  of  autonomy  to  include  such  a  case? 

While  it  is  true  that  programs  need  to  be  created  by  some  programmer,  even  programs  written  by 
other  programs,  there  will  always  be  some  external,  human  cause  for  whatever  actions  machine 
exhibit;  so  artificial  autonomy  would  be  Impossible  if  no  person  can  play  a  role  in  the  causal  chain, 
especially  at  the  programming  level.  Indeed,  the  philosophical  position  that  free  will  does  not  exist 
seems  to  depend  on  a  related  argument,  that  In  a  scientific,  deterministic  world,  there  must  be  some 


^  A  logical  implication  of  this  is  that  all  robots,  as  we  define  them,  will  have  some  degree  of  autonomy,  making 
'autonomous  robot'  a  redundant  expression;  but  we  will  nevertheless  keep  with  this  expression  to  signal  that  we  are 
referring  to  robots  that  have  a  greater  degree  of  autonomy  than  usual,  If  one  considers  autonomy  as  a  spectrum  from 
unthinking  automatons  (such  as  bacteria  and  simple  organisms)  to  semi-autonomous  beings  (such  as  children,  some 
animals,  and  some  robots  today)  to  fully-autonomous,  moral  agents. 
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prior,  external  cause  for  our  behavior  that  we  are  not  responsible  for  (and  thus  we  are  not 
responsible  for  our  consequent  actions  or  even  have  the  power  to  alter  that  chain  of  events). 

So  to  avoid  this  problem,  let  us  stipulate  that  artificial  autonomy  is  possible  and  that  it  does  not 
imply  that  a  machine's  actions  are  undetermined  or  unpredictable  (as  may  be  required  in  the  usual 
conception  of  free  will).  This  seems  to  require  that  we  exempt  programmers  and  designers  from  the 
cons  dered  causal  chain,  such  that  a  robot  running  a  sophisticated  program  may  be  considered  to  be 
semi-  or  fully-autonomous,  even  though  its  actions  may  be  predetermined  given  certain 
environmental  conditions,  at  the  programming  or  design  level.  Thus,  we  may  also  consider  some 
computers  today  to  be  semi-autonomous  in  letting  loose  a  self-directed  avatar  upon  the  virtual 
world. 

Given  our  use  of  'autonomy'  here,  a  semi-  or  fully-autonomous  robot  would  be  able  to  choose  to 
perform  at  least  some  actions  'on  its  own'  or  without  a  human  determining— at  least  not  at  a  design 
or  programming  level— what  course  of  action  it  should  take.  Thus  to  refine  our  initial  definition,  we 
take  autonomy  in  machines  to  mean:  the  capacity  to  operote  in  the  reohworld  environment  without 
ony  form  of  external  control,  once  the  machine  is  activated  and  at  leost  in  some  oreos  of  operation, 
for  extended  periods  of  time. 


A.3  Ethics 


Final  y,  in  this  report,  we  use  the  term  'ethics'  broadly  to  include  not  just  normative  issues,  i.e., 
questions  about  what  we  should  or  ought  to  do,  but  also  general  concerns  related  to  social  and 
cultural  impact  as  well  as  risk,  e.g.,  responsibility  after  a  malfunction,  arising  from  the  use  of 
robotics.  As  a  result,  we  will  cover  all  these  areas  in  our  report,  not  just  philosophical  questions  or 
ethical  theory,  with  the  goal  of  providing  some  relevant  if  not  actionable  at  this  preliminary  stage. 
(This  diverges  from  the  traditional,  more  narrow  conception  of  ethics,  at  least  as  understood  in 
academic  philosophy.) 

A  note  on  the  issue  of  ethics:  Is  robot  ethics  a  subset  of  military  ethics,  or  computer  ethics,  or  some 
other  area  of  ethics?  We  believe  that  robot  ethics  is  emerging  to  become  a  field  unto  its  own.  There 
is  still  a  critical  gap  between  machine  or  computer  ethics  and  military  ethics,  in  which  important 
questions  are  only  now  being  raised  about  the  moral  responsibility,  risk,  and  just  use  in  war  of 
relatively  autonomous  systems  (robots  or  computer  networks).  Further,  robot  ethics  is  not  limited 
to  military-related  issues;  there  are  new  dilemmas  related  to  the  use  of  robots  as  a  proxy  for  elderly 
care,  for  sexual  relationships,  for  human  workers  especially  those  with  specialized  skills  such  as 
surgeons,  and  so  on.  Thus,  the  introduction  of  'smart'  robotics  into  the  military  and  the  marketplace 
has  implications  for  both  military  and  other  ethics,  with  potentially  transformative  consequences  on 
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many  traditional  issues,  such  as  the  nature  of  personhood,  agency,  autonomy,  and  even  what  it 
means  to  be  a  soldier. 
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Appendix  B:  Contacts 


1.  Patrick  Lin,  Ph.D. 

California  Polytechnic  State  University 

Ethics  &  Emerging  Technologies  Group 

Philosophy  Department 

1  Grand  Avenue 

3uilding  47,  Room  37 

San  Luis  Obispo,  California  93407 

Email:  palin@calpoly.edu 

Dept,  phone:  805<756-2041 

2.  George  Bekey,  Ph.D. 

California  Polytechnic  State  University 

Ethics  &  Emerging  Technologies  Group 

Biomedical/General  Engineering  Department 

Building  13,  Room  260 

San  Luis  Obispo,  California  93407 

email:  gbekey@calpoly.edu 

Dept,  phone:  805-756-6400 

3.  Keith  Abney,  M.A. 

California  Polytechnic  State  University 

Ethics  &  Emerging  Technologies  Group 

Philosophy  Department 

1  Grand  Avenue 

Building  47,  Room  37 

San  Luis  Obispo,  California  93407 

email:  kabney@calpoly.edu 

Dept,  phone:  805-756-2041 
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Unmanned  Aircraft  Systems;  Situational  Awareness  for  Small 
Tactical  Unmanned  Aircraft  and  an  Autonomous  Package 
Delivery  Concept  Study  for  the  US  Marines 


Project  Investigator: 


Rob  McDonald 

Department  of  Aerospace  Engineering 
California  Polytechnic  State  University 
San  Luis  Obispo,  CA 


385 


N00014-()7-l-1152 


P.l. Susan  C.  Opava,  Ph.D. 


Unmanned  Aircraft  Systems; 

Situational  Awareness  for  Small  Tactical  Unmanned  Aircraft  and 
An  Autonomous  Package  Delivery  Concept  Study  for  the  US  Marines 

Project  Report 

Rob  McDonald,  Ph.D. 

Aerospace  Engineering 
California  Polytechnic  State  University 


Project  Impact 

This  C3RP  research  project  funded  in  February  2008  has  been  a  great  catalyst  to  the 
development  of  a  UAV  research  program  at  Cal  Poly.  Although  the  no  cost  extension  ended  with  the 
close  of  2008,  work  continues  on  this  project  to  this  day.  This  project  can  claim  a  number  of  direct  and 
indirect  products. 

This  project  has  directly  resulted  in  one  Aerospace  Engineering  (AERO)  MS  Thesis  project 
(Shane  Wallace)  which  will  be  finished  in  September  2009.  It  has  also  produced  two  AERO  senior 
projects  (Andrew  Ezzard  and  Ryan  Halpcr)  and  a  summer  project  for  a  Computer  Engineering 
undergraduate  student  (Nick  Utchig). 

As  a  result  of  this  project,  the  PI  joined  with  AeroMech  Engineering  to  submit  a  $3M  proposal 
to  an  Office  of  Naval  Research  BAA.  The  BAA  was  not  funded,  but  a  strong  relationship  with 
AeroMech  continues. 

This  project  has  resulted  in  two  conference  papers,  with  the  possibility  of  more  to  come. 

Ezzard,  A.,  Vallone,  M.,  and  McDonald,  R.,  Underpowered  Aircraft  -  Performance  and  Operational 
Possibilities.  AIAA  Aerospace  Sciences  Meeting,  January  5-8,  2009,  Orlando  Florida. 

AIAA  2009-1441. 

Wallace,  S,  and  McDonald,  R.,  Situational  Awareness  for  Small  Tactical  Unmanned  Aircraft.  AIAA  Aerospace 
Sciences  Meeting,  January  2010,  Orlando  Florida,  Accepted  for  presentation. 

The  indirect  products  of  this  project  are  perhaps  even  more  significant.  This  project  initiated  a 
UAV  research  program  which  has  gained  the  attention  of  industry  and  government.  In  the  Spring  of 
2009,  Northrop  Grumman  donated  an  unmanned  Yamaha  RMAX  helicopter  to  Cal  Poly.  An  autopilot 
is  being  obtained  for  the  RMAX;  when  installed,  it  will  provide  a  first-rate  fully  autonomous  research 
platform. 

The  ceremony  transferring  the  RMAX  to  Cal  Poly  caught  the  eye  of  the  San  Luis  Obispo 
Sherrifs  office  Search  and  Rescue  (SAR)  team.  Computer  Engineering  professor  Dr.  Lynne  Slivovsky 
and  the  PI  have  been  meeting  with  the  SAR  team  about  possible  collaboration  and  state  funding 
opportunities. 

Also  in  the  Spring  of  2009,  the  Air  Force  Flight  Test  Center  at  Edwards  Air  Force  Base 
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approached  the  PI  about  submitting  a  research  proposal  in  the  area  of  UAV's.  A  proposal  was 
submitted  in  collaboration  with  Mechanical  Engineering  professor  Dr.  Russ  Westphal;  notification  of 
funding  was  received  in  August  2009.  This  project  will  support  the  design  and  construction  of  a  UAV 
to  be  used  as  a  flight  test  instrumentation  development  platform. 

Autonomous  Package  Delivery  Concept  -  Underpowered  Aircraft 

A  unique  aircraft  concept  known  as  an  Underpowered  Aircraft  was  studied  in  its 
appropriateness  for  a  mission  in  support  of  US  Marine  Seabasing.  The  Underpowered  Aircraft  allows 
for  the  modification  of  gliding  flight  vehicles  for  increased  range  and  lower  cost  when  compared  with 
fully  powered  flight  vehicles. 

Intentionally  under-sizing  the  powerplant  for  a  flight  vehicle  allows  the  designer  to  choose  a 
powerplant  that  will  not  only  perform  the  mission  requirements,  but  will  also  provide  the  customer  with 
the  most  cost  effective  solution,  as  some  missions  may  not  require  fully  powered  flight.  Specifically, 
the  underpowered  aircraft  concept  studied  in  this  project  is  a  gliding  flight  aircraft  that  does  not  have 
enough  power  for  climbing  or  level  flight,  but  does  have  enough  power  to  overcome  some  of  the  drag 
forces  associated  with  flight,  in  turn  increasing  the  effective  range  of  the  vehicle. 

The  underpowered  aircraft  concept  was  analyzed  and  its  feasibility  was  determined.  Analysis 
done  using  equations  of  motion,  followed  by  a  more  accurate  numerical  integration  including  a  thrust 
lapse,  determined  that  the  underpowered  aircraft  concept  provides  a  unique  method  for  a  cost  effective 
range  extension  technology  for  gliding  flight  vehicles.  The  technology  and  methods  of  this  study  were 
applied  to  the  AGM-1 54  JSOW  and  JSOW-ER  glide  munitions  and  it  was  determined  that  JSOW-ER  is 
representative  of  an  underpowered  aircraft  with  our  analysis. 

The  AIAA  paper  and  ONR  BAA  proposal  which  resulted  from  this  effort  are  attached  to  this 
report  for  review 

Situational  Awareness  for  Small  UAV's  -  Laser  Scanner  and  Collision  Avoidance 

This  project  has  supported  a  comprehensive  effort  to  develop  a  low  cost  collision  avoidance 
capability  for  small  UAV's.  By  comprehensive,  it  is  meant  that  a  number  of  sub-projects  have  been 
undertaken  each  building  toward  the  overall  goal.  These  sub-projects  include  the  design,  simulation, 
and  test  of  each  component  in  the  system. 

Testbed  UAV 

The  off-the-shelf  Piccolo  LT  autopilot  was  integrated  into  a  standard  radio  control  aircraft.  All 
sensors,  antennae,  and  electronics  were  installed  in  the  aircraft  (Figure  1).  Aerodynamic,  propulsion, 
mass,  and  stability  models  of  the  aircraft  were  built  and  programmed  into  the  autopilot.  The  aircraft 
was  simulated  in  the  autopilot  simulation  software,  where  the  models  were  tested  and  the  control  gains 
were  tuned.  Once  the  team  was  satisfied  with  the  simulation,  the  autonomous  aircraft  was  test-flown  at 
the  Cal  Poly  Educational  Flight  Range  (EFR)  (Figure  2  and  3). 
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Figure  1:  Piccolo  LT  autopilot 
integration. 


Figure  2:  Ground  station  and  test  flight. 


Figure  3:  Ground  station  software. 


Software-Only  Laser  Range  Finder  Simulator 


A  software-only  simulation  of  the  seanning  laser  ineluding  terrain  and  buildings  was  ereated. 
Simulation  of  the  laser  is  deeeptively  eomplex.  The  terrain  and  buildings  must  be  modeled  by  a  large 
number  of  triangles  eombined  to  represent  the  surfaees  of  the  obstaeles  (Figure  4  and  5).  The  laser 
must  be  oriented  to  the  latitude,  longitude,  altitude,  heading,  elimb,  and  roll  of  the  aireraft  as  well  as  the 
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two  axes  of  rotation  of  the  laser  gimbal.  Then,  a  'ray'  must  be  traced  from  the  laser  into  space.  An 
intersection  test  between  the  ray  and  every  triangle  must  be  performed  (Figure  6).  This  gets  very 
expensive  for  complex  terrain;  the  computation  must  be  done  in  real-time,  the  laser  takes 
measurements  at  200Hz. 


Figure  4:  Simulated  buildings. 


Figure  5:  Simulated  terrain  around  San  Luis  Obispo. 


Figure  6:  Simulator  generated  depth  map  of  San  Luis  Obispo  terrain. 


In  addition  to  simulating  the  distance  measurements  taken  by  the  laser,  the  laser  simulator  must 
communicate  with  the  flight  simulation  to  know  the  aircraft  position  and  orientation.  The  laser  sim 
must  also  receive  gimbal  position  commands  from  and  send  laser  measurements  to  the  guidance 
algorithm.  Finally,  the  guidance  algorithm  must  communicate  modified  waypoints  to  the  autopilot  to 
direct  the  aircraft  away  from  an  obstacle  (Figure  7). 
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Figure  7:  Integration  of  laser  simulator  with  flight  simulator  and  ground  control  software. 


Potential  Function  Collision  Avoidance  Guidance 

The  final  sub-project  in  this  effort  has  been  the  development  of  the  actual  guidance  algorithms 
which  will  cause  the  aircraft  to  avoid  any  sensed  obstacles.  This  theoretical  and  applied  effort  has  been 
the  primary  focus  of  the  MS  Thesis  project  which  will  be  completed  in  September  2009.  The  use  of  a 
potential  function  allows  the  onboard  computer  to  efficiently  make  decisions  to  avoid  obstacles  with  a 
minimum  of  input  data  and  little  computational  expense. 

In  the  potential  function  approach,  the  specified  waypoint  navigation  is  represented  with  'sinks' 
which  draw  the  aircraft  towards  them.  Simultaneously,  the  obstacles  detected  by  the  laser  (terrain, 
buildings,  trees,  etc)  are  represented  by  'sources'  which  repel  the  aircraft.  The  sources  and  sinks 
combine  to  produce  a  smooth  potential  surface;  the  guidance  algorithm  directs  the  aircraft  along  the 
gradients  in  this  surface  to  follow  a  minimum  potential  path. 

A  simulated  flight  showing  terrain  avoidance  is  depicted  below  in  Figure  8. 


Figure  8:  Simulated  flight  avoiding  terrain. 


The  MS  Thesis  and  conference  paper  resulting  from  this  work  will  be  appended  to  this  report 
when  they  arc  completed. 
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Sandwich  Composite  Report 


Project  Investigator: 


Nilanjan  Mitra 

Department  of  Civil  and  Environmental  Engineering 
California  Polytechnic  State  University 
San  Luis  Obispo,  CA 
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Introduction 

Sandwich  composite  panels  represents  a  special  form  of  laminated  composite  material  in 
which  a  relatively  thick,  lightweight  and  complaint  core  material  separates  thin  and  strong  face 
sheets.  These  panels  are  being  increasingly  utilized  currently  for  major  load  bearing  structures 
in  civil,  mechanical,  marine,  automotive  and  aerospace  industries.  The  reason  for  its  wide 
current  use  is  primarily; 

'•  High  strength  to  low  weight  ratio  -  Vehicular  structures  made  out  of  these  are 
i  hereby  capable  of  greater  range  and  speed;  would  require  less  fuel  consumption;  and  can 
also  be  used  for  greater  payload. 

Significant  less  maintenance  cost  compared  to  conventional  materials  and  thereby 
performs  well  in  life-eyele  cost  analysis  of  the  structure.  As  an  alternative  to  steel,  these 
materials  donot  corrode. 

"  Cost  of  construction  is  also  comparatively  less  and  relatively  easy  to  manufacture 
if  complex  shapes  are  required  for  different  reasons  in  the  vehicular  industry. 

'•  Research  has  also  demonstrated  that  sandwich  composite  panels  have  improved 

fatigue  and  vibration  resistance  performance  compared  to  their  conventional  counterparts. 

••  These  panels  have  also  demonstrated  their  potential  as  a  protection  against  blast 
and/or  impact.  The  light  weight  dense  core  would  be  able  to  absorb  energy  released  for 
blast  and/o  impact. 

*•  Panels  also  posses  low  magnetic,  infrared  and  radar  cross-sectional  signatures  and 


thereby  used  as  a  suitable  alternative  for  marine  and  Inspite  of  the  numerous  advantages 
mentioned  above,  sandwich  composite  panels  have  significant  drawbacks  and  is  thereby  an 
active  area  of  research.  The  sandwich  composite  panels  dealt  with  in  this  manuscript  are 
typically  used  for  marine  construction  and  are  notoriously  sensitive  to  failure  by  shear  load. 
Shear  strength  is  one  of  the  primary  design  eriterions  in  application  of  these  structures  for 
marine  environment.  An  example  application  area  is  the  bottom  of  large  high  speed  ships 
subjected  to  high  sea  pressures  which  might  result  in  shearing  of  the  bottom  along  its 
perimeter.  Details  about  the  properties  of  the  component  materials,  method  of  manufacture, 
experimental  methods  and  analytical  simulations  are  provided  in  the  following  sections. 


Component  material  properties  for  sandwich  composites  used  in  marine/naval  vessel 
construction 

The  skin  is  composed  of  glass  reinforced  polymer  composites  and  is  made  up  of  two 
alternative  layers  of  chopped  strand  mat  and  woven  rovings.  The  core  material  is  composed  of 
PVC  foam.  Epoxy  resin  was  utilized  as  the  adhesive  material.  Method  of  construction  of  the 
samples  was  vacuum  resin  infusion. 
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Glass  fibre  composites 

Glass  fibre  composites  used  as  skins  for  the  sandwich  composite  panels  are  typically 
made  up  of  chopped  strand  mats  and  woven  rovings. 

The  fibers  in  a  chopped  strand  mat  are  typically  3-4  inches  in  length  and  are  randomly 
oriented.  Chopped  strand  mat  is  not  a  very  strong  material  because  of  the  short  fiber 
length.  However,  it  is  isotropic.  This  means  that  it  is  equally  strong  in  all  directions.  Mat 
and  fillers  are  the  only  composite  reinforcements  exhibiting  this  trait.  This  is  the  least 
expensive  reinforcement  form  and  is  thus  the  most  widely  used.  The  weight  of  chopped 
strand  mat  used  in  the  current  construction  is  1 .5  oz/ft^  (0.44  kg/m^).  Typically,  this  is 
designed  for  use  with  polyester  resin  or  vinyl  ester  resin.  The  manual  reports  that  it  is  not 
compatible  with  epoxy  resin  but  in  the  current  study  epoxy  resin  has  been  used  and  no 
detrimental  effect  was  observed.  It  should  also  be  noted  that  to  form  the  glass  fibre 
composite  skins,  chopped  strand  mats  were  used  in  combination  with  woven  rovings. 
Woven  roving  is  made  from  continuous  glass  fiber  roving  which  are  interlaced  into  heavy 
weight  fabrics.  The  weight  of  the  woven  roving  used  in  current  construction  is  18  oz/yd^ 
(0.61  kgW). 

Uniaxial  tensile  tests  were  performed  for  both  woven  rovings  and  chopped  strand  mat  in 
an  INSTRON  machine  as  per  ASTMD3039  “Standard  test  method  for  tensile  properties 
of  polymer  matrix  composites”  to  determine  the  ultimate  tensile  strength,  modulus  of 
elasticity  and  poisons  ratio  of  the  materials.  The  CSM  and  the  WR  specimen  are  made  up 
of  two  layers  of  chopped  strand  mat  and  woven  roving  sheets  respectively  bonded 
together  with  epoxy  resin.  The  following  figure  shows  the  materials  being  tested. 


ASTM  D3039  setup 


CSM  WR 


Figure  1.  ASTM  D3039  test  for  chopped  strand  mat  and  woven  roving 
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In  the  experimental  investigations,  as  demonstrated  in  Figure  1,  the  mode  of  failure  as 
observed  for  the  specimens  were  brittle.  As  observed  from  the  experimental 
investigation,  a  linear  elastic  material  model  was  utilized  in  the  numerical  simulations  to 
represent  the  behaviour  of  both  CSM  and  WR.  The  poisons  ratio  for  the  woven  roving  is 
taken  as  0.01;  which  means  that  there  is  no  coupling  between  the  longitudinal  and  the 
transverse  strain  when  loaded  uniaxially.  For  the  CSM,  the  poisons  ratio  was  observed  as 
0.4.  The  modulus  of  elasticity  of  WR  is  2x10^  psi  (13.8  GPa)  whereas  for  the  CSM  is 
1.7x10^  psi  (1 1.8  GPa).  The  failure  stress  for  CSM  samples  were  recorded  as  12000  psi  at 
7100  microstrain  whereas  for  the  WR  samples  it  was  43700  psi  at  14700  microstrain. 

P  VC  foam  -  Divinycell  HI  00 

The  core  material  typically  chosen  for  marine/naval  ship  hull  constructions  is  closed  cell 
semi-rigid  poly-vinyl-chloride  foam  with  a  density  of  100  kgW  manufactured  by  DIAB 
Inc.  and  marketed  by  the  trade  name  of  Divinycell  HI 00.  The  foam-core  thickness 
considered  for  the  experimental  investigation  is  30  mm  and  the  foam  material  has  a  cell 
size  of  approximately  400|am.  Tensile,  compressive  and  shear  tests  were  done  on  the 
foam  samples  to  determine  their  strengths.  It  was  observed  that  the  material  is  ductile  in 
nature  in  compression  however  brittle  in  tension.  Since  material  models  are  not  available 
which  will  account  for  two  different  failure  mechanisms  as  two  different  loading 
scenarios,  plastic  material  models  are  being  utilized  for  defining  the  behaviour  of  these 
foam  materials.  The  downside  of  choosing  plasticity  material  model  will  be  the  material 
model  would  not  provide  good  post-peak  response  in  tension. 

Uniaxial  compressive  test  was  performed  on  these  foam  materials  as  per 
recommendations  of  ASTMC365  “Standard  test  method  for  flatwise  compressive 
properties  of  sandwich  cores”.  The  size  of  the  specimen  considered  was  75  by  75  mm. 
The  standard  head  displacement  rate  for  the  INSTRON  1331  universal  testing  machine 
was  kept  at  0.05  in/min.  The  stress  strain  curve  obtained  from  the  investigation  is  shown 
in  figure  2.  A  load  rate  study  was  also  performed  (by  varying  load  rates  to  0.05,  0.1  and 
0.2  in/min)  on  the  foam  sample  and  no  significant  changes  with  regards  to  stiffness  and 
or  the  strength  were  observed  for  the  specimen. 

:i5() 


Figure  2.  Compressive  response  of  Divinycell  HI  00  semi  rigid  foam 
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Cyclic  compressive  test  was  also  carried  out  on  the  foam  sample  to  determine  the 
unloading  and  reloading  characteristics  of  the  specimen.  Even  though  material 
characteristics  associated  with  unloading  and  reloading  are  not  going  to  be  utilized  in  this 
research,  this  information  would  be  useful  for  later  investigations  involving  fatigue  and 
cyclic  loading  of  structures.  The  stress  strain  response  obtained  from  the  investigation  is 
shown  in  figure  3.  The  loading  rate  was  kept  the  same  as  that  of  the  ASTM  C365  test  at 
0.05  in/min. 


Figure  3.  Cyclic  compressive  response  of  Divinycell  HI 00  semi  rigid  foam 

Uniaxial  tensile  tests  were  also  carried  out  for  foam  samples  as  per  recommendations  of 
ASTM  C297  “Standard  test  method  for  flatwise  tensile  strength  of  sandwich 
constructions”.  Initially  the  size  of  the  specimen  considered  was  similar  to  that  of  the 
uniaxial  compressive  tests.  However,  it  was  later  realized  that  75x75x30  mm  test  coupons 
might  result  in  triaxial  effects  and  thereby  200x50x30  mm  test  coupons  were  taken  to 
account  for  the  uniaxial  tensile  test.  The  standard  head  displacement  rate  for  the 
INSTRON  machine  was  kept  the  same  at  0.05  in/min.  The  stress  strain  response  obtained 
from  the  investigation  is  shown  in  figure  4. 

300 


Figure  4.  Uniaxial  tensile  response  of  Divinycell  HI 00  semi  rigid  PVC  foam 
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Inplane  shear  test  on  the  foams  was  performed  as  per  recommendations  of  ASTM  C273 
“Standard  test  method  for  shear  properties  of  sandwich  core  materials”.  The  standard 
head  displacement  rate  of  the  INSTRON  machine  is  kept  at  0.05  in/min.  The  shear  jigs 
were  manufactured  out  of  steel,  which  were  used  in  shear  tests  for  both  the  foam  as  well 
as  the  sandwich  composite.  The  figure  below  shows  the  manufactured  shear  jig  and  its 
attachment  to  the  INSTRON  machine.  The  foam  specimens  (16x2x1.18  in  or  406x50x30 
mmi  are  attached  to  the  shear  jig  by  means  of  structural  glue  DP460NS.  This  structural 
glue  is  a  high  performance,  non  sag,  two  part  epoxy  adhesive  (B-  Epoxy  and  A-  Amine; 
Mix  ratio  2:1;  Viscosity  cp  B-150k-275k  and  A-8000-14000)  offering  shear  strength  of 
4650  psi  and  a  peel  strength  of  60  along  with  high  levels  of  durability  at  room 
temperature.  Cracks  were  observed  at  an  angle  in  the  foam  specimen  and  propagated 
from  one  side  attached  to  the  shear  jig  to  the  other  side.  The  stress-strain  response 
observed  from  investigation  is  shown  in  figure  6. 


Figure  5.  Shear  jigs  for  ASTM  C373  tests 
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Figure  6.  Inplane  shear  response  for  Divinycell  HI 00  PVC  foam 


Since  hydrostatic  pressure  also  influences  the  material  response  of  foam  materials, 
hydrostatic  compression  test  was  also  carried  out  for  foam  materials.  However  the 
experimental  response  did  not  result  in  significant  conclusions  since  it  was  limited  by  the 
load  that  can  be  applied  by  the  facility/instrument  available.  Hydrostatic  compression  test 
typically  means  application  of  an  isotropic  pressure  on  all  sides  of  a  cube  sample  and 
measuring  the  pressure  applied  to  that  of  the  volumetric  strain  of  the  cube.  There  aren’t 
any  ASTM  specifications  for  this  test,  so  triaxial  tests  that  are  used  to  apply  triaxial 
loading  to  soil  samples  in  Geotechnical  laboratory  at  CalPoly  were  modified  to  apply  a 
stress  controlled  triaxial  isotropic  pressure  on  a  small  cube  sample  of  the  foam  material 
with  30  mm  dimension.  The  triaxial  testing  apparatus  in  Calpoly  applies  a  axial  pressure 
and  the  surrounding  pressure  of  water  was  manually  adjusted  to  match  the  axial  pressure 
thereby  to  simulate  a  triaxial  isotropic  pressure.  The  test  setup  is  shown  in  figure  7. 


Figure  7.  Hydrostatic  compression  test  setup  in  CalPoly  for  foam 


Simulation  of  material  properties  for  sandwich  composite  panel 
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Linear  elastie  material  model  is  used  for  CSM  and  WR.  Material  properties  for  CSM  and 
WR  have  been  obtained  from  experimental  investigations.  For  the  foam  eore  material,  a 
plastie  material  model,  referred  to  as  “Crushable  foam  plastieity”  in  ABAQUS  has  been 
ealibrated.  A  brief  detail  of  the  material  model  and  its  ealibration  is  diseussed  in  the 
following  paragraphs. 

Crushable  foam  plasticity  with  isotropic  hardening 

It  v/as  observed  from  experimental  investigations  that  the  Divinyeell  HI 00  foam  did 
undergo  permanent  deformation  in  eompression.  Thereby  a  plastieity  type  of  model 
would  obviously  be  required  for  defining  the  eonstitutive  relation  of  the  foam  material. 
However,  it  should  also  be  mentioned  that  the  response  in  tension  for  the  foam  was  brittle 
and  a  plastieity  type  model  would  not  be  ideal  for  modeling  that.  But  sinee  no  better 
models  were  available  in  ABAQUS,  the  model  that  was  used  for  the  eurrent  study  is 
Crushable  foam  plastieity  model  in  ABAQUS.  In  this  manuseript,  input  parameters  have 
been  deseribed  from  a  user’s  viewpoint  to  ealibrate  the  response  obtained  from 
experimental  investigation.  Calibration  of  erushable  foam  plastieity  model  requires  input 
values  for  modulus  of  elastieity,  poisons  ratio,  yield  stress  and  the  hardening  envelope. 
Details  about  the  CRUSHABLE  FOAM  PLASTICITY  model  are  provided  in  Deshpande 
and  Fleek  (2000)  as  well  as  in  ABAQUS  manual.  A  brief  about  the  model  formulation  is 
provided  in  the  manuscript  for  brevity  and  completeness. 

The  yield  surface  of  the  material  model,  defined  in  the  p-q  stress  field,  is  represented  as 
F=--^q^+a\p-p,f  -B  =  Q 

where  q  represents  the  Mises  stress  and  p  represents  the  hydrostatic  stress.  The  Mises 
stress  q  ean  be  represented  as  where  Jj  represents  the  second  invariant  of  the 
deviatoric  stress  tensor;  the  hydrostatic  stress  p  can  be  represented  as  f/S  where  7/  is  the 
first  invariant  of  the  stress  tensor.  The  flow  potential  for  the  material  model,  also  defined 
in  the  p-q  stress  field,  is  represented  as 

The  above  two  definitions  for  the  yield  stress  and  the  flow  potential  is  represented  in  the 
following  figure 


(tow  poiental 


Figure  8.  Yeild  stress  and  flow  potential  of  the  Crushable  Foam  Plasticity  model  (in 
ABAQUS) 
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where  pc  and  pt  refers  to  yield  strength  in  hydrostatic  compression  and  tension 
respectively.  The  parameter  po  refers  to  the  center  of  the  yield  ellipse  and  is  given  as 


n  - 

P«-  2 

The  parameter  B  defines  the  maximum  q  stress  and  is  represented  as 
B  =  aA  =  aP^ 


where  A  represents  the  length  of  /?-axis  of  the  yield  ellipse.  The  shape  factor  a  remains 
constant  during  any  plastic  deformation  process.  The  evolution  of  the  yield  ellipse  or  the 


hardening  envelope  is  controlled  by  a  plastic  strain  measure,  which  is  the  volumetric 
compacting  plastic  strain,  -Sy/,/  (trace  of  plastic  strain  tensor)  for  the  case  of  volumetric 

hardening  model;  and  equivalent  plastic  strain,  ,  which  is  defined  as  the  absolute  value 
of  the  axial  plastic  strain  for  a  bar  loaded  in  uniaxial  compression,  for  the  case  of 
isotropic  hardening.  The  yield  surface  and  its  evolution  for  the  two  type  of  hardening 
models:  volumetric  and  isotropic  are  shown  in  the  figure  below. 


3  2 

Figure  9.  Evolution  of  the  yield  surface  for  volumetric  hardening  case 


3 


Figure  10.  Evolution  of  the  yield  surface  for  the  isotropic  hardening  case 
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It  should  be  noted  that  for  an  isotropic  hardening  envelope,  hydrostatic  stress  in  tension  is 
considered  to  be  same  as  that  of  hydrostatic  stress  in  compression,  and  thereby  the  center 
of  the  ellipse  is  at  the  origin  of  the  p-q  stress  plane.  Moreover  for  the  isotropic  hardening 
model,  the  hardening  envelope  is  same  for  tension  as  that  in  compression.  The  hardening 
envelope  for  the  compression  response  is  similar  to  that  in  tension.  On  the  other  hand,  for 
the  volumetric  hardening  model,  the  hydrostatic  stress  in  tension  doesn’t  change  or 
evolve. 

For  the  volumetric  hardening  model,  the  value  of  a  is  given  as 


a  = 


where 


and  k,= 


The  superscript  0  refers  to  initial  yield  surface.  The  term  cr  refers 
Pc 


to  uniaxial  stress  whereas  the  term  p  refers  to  hydrostatic  stress.  The  subscript  t  refers  to 
tension  whereas  the  subscript  c  refers  to  compression.  For  a  valid  yield  surface  the  choice 
of  yield  stress  ratios  must  be  such  that  0<kc<3  and  kt  >=  0.  A  plot  of  a  is  provided  with 
changes  in  values  of  k,  and  kc  in  the  figure  below.  As  the  value  of  a  is  increased,  the  yield 
stress  of  the  foam  material  can  also  be  increased.  The  value  of  P  chosen  to  represent  the 
volumetric  hardening  model  is  3/V2  =  2.12.  For  this  hardening  model,  zero  plastic 
Poissons  ratio  is  considered  thereby  resulting  in  for  uniaxial  compression 


loading. 
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For  the  isotropic  hardening  model,  po  =  0  since  the  yield  stress  in  hydrostatic  tension  is 
same  as  that  in  compression.  The  value  of  a  is  given  as 


a  = 


with  kc  as  defined  above.  For  many  low  density  foams,  the  initial  yield 


surface  is  close  to  a  circle  in  the  p-q  stress  plane,  which  indicates  the  value  of  a  is 
approximately  1 .  The  term  /?  representing  the  shape  of  the  flow  potential  in  the  p-q  stress 
plane  is  related  to  the  plastic  poisons  ratio,  vj,  as 


The  plastic  Poisson's  ratio,  which  is  the  ratio  of  the  transverse  to  the  longitudinal  plastic 
strain  under  uniaxial  compression,  should  be  defined  by  the  user;  and  it  must  be  in  the 
range  of-1  and  0.5.  The  upper  limit  of  0.5  corresponds  to  an  incompressible  plastic  flow. 
For  low  density  foams,  the  value  of  plastic  poisons  ratio  is  typically  taken  as  0. 

For  definition  of  the  crushable  foam  plasticity  model,  one  should  define  the  modulus  of 
elasticity,  poisons  ratio  and  the  hardening  envelope  in  tabular  form.  If  isotropic  hardening 
is  modeled  then  the  user  needs  to  define  the  parameter  kc  and  also  plastic  poisons  ratio; 
on  the  other  hand  for  modeling  volumetric  hardening  model,  the  user  must  define  the 
parameters  kc  and  kt.  For  isotropic  hardening  the  plastic  flow  is  associated  when  the  value 
of  a  is  the  same  as  that  of  /?.  By  default,  the  plastic  flow  is  nonassociated  to  allow  for  the 
independent  calibrations  of  the  shape  of  the  yield  surface  and  the  plastic  Poisson's  ratio. 
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If  information  is  known  only  about  the  plastic  Poisson's  ratio  and  the  user  chooses  to  use 
associated  plastic  flow,  the  yield  stress  ratio  Av  can  be  calculated  from 

Initially  volumetric  hardening  was  chosen  for  the  purpose  of  analysis.  Since  experimental 
investigations  of  hydrostatic  tension  and  compression  test  could  not  be  performed  for  the 
foam  sample,  a  numerical  parametric  investigation  was  carried  out  to  determine  the 
conect  value  of  k,  and  kc  for  the  foam  samples  so  that  the  numerical  model  chosen 
simulates  good  comparable  behavior  in  uniaxial  tension,  uniaxial  compression  and  in- 
planc  shear  loading.  The  value  finally  chosen  for  A,  and  kc  are  1 .9  and  2.0  respectively. 
The  values  for  modulus  of  elasticity  (60  Mpa),  poisons  ratio  (0.1)  and  a  tabular  listing  of 
the  hardening  envelope  were  obtained  from  experimental  investigations.  It  should  be 
noted  that  the  values  of  k,  and  kc  donot  affect  the  compressive  response  but  affects  the 
response  in  tension  and  shear.  Figure  1 1  shows  compressive  response  simulation  with  the 
above  defined  parameters.  Variation  of  response  is  also  shown  with  changes  in  the 
modulus  of  elasticity  and  poison’s  ratio,  as  shown  in  Figure  12.  The  blue  dotted  line 
represents  the  analytical  simulation  using  ABAQUS  and  black  firm  line  represents  the 
experimental  investigation  results. 

550  2.5 


Figure  1 1.  Compression  stress  strain  response  (experimental  and  simulations) 
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Figure  12.  Variations  in  response  with  different  E  and  nu 
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Since  the  type  of  hardening  response  (volumetric  or  isotropic)  doesn’t  influence  the 
compressive  response,  same  simulation  results  are  obtained  with  isotropic  hardening 
model  instead  of  volumetric  hardening  model.  Parameters  that  need  to  be  defined  for 
isotropic  hardening  model  are  kc  and  plastic  poisons  ratio  apart  from  the  usual  definitions 
of  modulus  of  elasticity,  poisons  ratio  and  hardening  envelope.  Parameter  kc  for  the 
isotropic  hardening  model  is  kept  at  2.0  while  plastic  poisons  ratio  is  chosen  as  0.  It 
should  be  noted  that  nonassociated  plasticity  is  chosen  to  represent  the  foam  behavior. 

It  should  be  noted  here  that  even  though  the  calibrated  model  performs  well  in  monotonic 
loading,  will  not  provide  a  good  response  in  cyclic  loading  since  damage  cannot  be 
captured  with  this  model;  for  which  a  damage  plasticity  model  would  be  required. 
Simulation  with  the  above  properties  was  carried  out  to  determine  the  tensile  response  of 
the  foam  model.  Based  on  experimental  observations  of  tensile  and  compressive  response 
(in  figures  2  and  4),  it  can  be  observed  that  there  exists  a  difference  between  the  elastic 
modulus  in  tension  and  that  in  compression.  Moreover,  since  a  plasticity  type  model  was 
chosen,  there  exists  a  yield  plateau  which  in  reality  is  not  true  typically  for  the  tensile 
response.  In  reality  the  foam  demonstrates  a  brittle  type  response  in  tension.  It  should 
also  be  noted  that  the  magnitude  of  the  tensile  strength  of  the  PVC  foam  is  nearly  the 
same  as  that  of  the  magnitude  of  the  compressive  yield  strength.  All  these  represent  the 
limitation  of  the  model  used  for  the  foam  material  and  will  be  addressed  in  later 
documents.  If  volumetric  hardening  model  with  the  above  parameters  was  chosen  the 
following  perfectly  plastic  simulation  is  observed  as  shown  below.  The  volumetric 
hardening  model  response  for  tension  is  obvious  since  the  yield  surface  and  the  evolution 
shows  that  the  numerical  model  is  perfectly  plastic  in  nature.  On  the  other  hand,  an 
isotropic  hardening  model  would  result  in  a  trilinear  response  as  shown  below.  Variations 
are  also  shown  for  different  k,  and  kc  values  for  the  volumetric  hardening  model  and  for 
different  values  of  plastic  poisons  ratio  for  the  isotropic  hardening  model.  It  should  be 
pointed  out  here  that  the  correct  value  of  kc  was  not  utilized  for  the  plastic  poisons  ratio 
variation  in  isotropic  hardening  model  which  results  in  lower  yield  strength. 


2.5 


train 

Figure  13.  Tensile  response  (experimental  and  simulated) 
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Figure  14.  Variation  in  tensile  simulated  response  with  different  E,  Kt  and  Kc 
(volumetric  hardening) 


2.5 


Figure  15.  Variation  in  tensile  response  with  different  plastic  poisons  ratio  (isotopic 
hardening) 

Simulations  with  the  above  properties  were  also  carried  out  for  shear  loading  on  a  foam 
sample.  Correlation  observed  between  observed  sample  and  simulated  sample  with 
volumetric  and  hardening  model  is  shown  in  figure  16.  For  a  volumetric  hardening 
model,  a  perfect  plasticity  type  model  is  obtained  whereas  a  hardening  type  of  response 
in  shear  was  obtained  with  the  isotropic  hardening  model.  It  should  be  noted  that  in 
reality  a  softening  type  of  response  is  observed  after  initial  hardening  which  is  due  to  the 
cracks  formed  in  the  foam.  However  since  hardening  type  plasticity  constitutive  law  has 
been  provided,  this  effect  cannot  be  captured. 
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Figure  16.  Shear  stress  strain  response  of  foam  (Experimental  and  simulated) 

Variations  in  response  of  the  volumetric  hardening  model  were  obtained  with  changes  in 
modulus  of  elasticity  along  with  k,  and  kc  values.  The  following  figure  shows  also  shows 
the  shear  test  raw  data  measured  with  the  cross  head  displacement  and  the  LVDT.  It  was 
observed  that  the  elastic  slope  varied  significantly  for  the  two  measurements  with  the 
LVDT  results  being  nearly  twice  stiffer  than  the  cross  head  results  (1.7  times  to  be  exact). 
Approximately  and  average  plot  between  the  two  responses  was  obtained  for  purpose  of 
comparison  with  simulation.  This  difference  in  result  is  due  to  the  inclination  of  the  shear 
jig  as  well  as  due  to  machine  compliance. 


0  2  4  6  8  10 

shear  strain  [angle  (deg)] 

Figure  17.  Variations  with  E,  Kt,  kc  (volumetric  hardening) 


2.5 


Manufacture  of  the  sandwich  composite  panel 
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The  process  of  manufacture  employed  in  this  project  is  vacuum  resin  infusion  (figure  18). 
In  this  process  the  foam  (core  material)  is  laid  in  between  layers  of  glass  fibre  skins.  Each 
of  the  glass  fibre  skins  on  either  side  of  the  foam  consist  of  two  alternate  layers  of 
chopped  strand  mat  (CSM)  and  woven  roving  (WR).  Peel  ply  is  then  laid  on  top  of  the 
skins  followed  by  a  breather  cloth.  The  entire  sample  is  then  bagged  and  air  in  the  bag  is 
extracted  by  means  of  a  vacuum  pump.  The  layup  of  the  entire  process  is  shown  in  figure 
19. 


Vacuum  Bagging  Rims 

pressure  C’nef 
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Figure  18.  Vacuum  resin  infusion  process 


Figure  19.  Layup  for  the  VRI  process 


The  total  amount  (weight)  of  resin  with  hardener  used  for  the  process  of  manufacture  is 
taken  to  be  the  same  as  the  weight  of  the  fiberglass  laminates  so  as  to  ensure  a  0.5  weight 
fraction  of  resin.  A  5:1  proportion  of  resin  and  hardener  is  used  respectively  for  this 
process  as  per  guidelines  of  the  West  Systems  epoxy  system.  The  resin-hardener  mixture 
is  then  distributed  over  the  entire  layup  through  T-fittings  and  vinyl  tubing  on  one  side 
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connected  to  the  resin-hardener  mixture  container.  The  distribution  is  done  by  creating 
vacuum  with  a  vacuum  pump  connected  through  tubes  on  opposite  side  of  the  resin- 
hardener  feeding  side.  Figure  20  shows  the  resin  flow  and  VRI  process  being  performed 
on  the  sample.  Approximately  it  takes  around  9-10  hrs  at  room  temperature  for  curing  of 
the  sample. 


Figure  20.  VRI  being  performed  on  the  sandwich  composite 


The  detailed  process  of  VRI  is  given  in  an  attached  report  prepared  by  Michael  Jacobson 
for  an  AERO  class  in  the  appendix. 

Experimental  shear  tests  on  conventional  composite  sandwich  panels 

The  final  product  obtained  after  the  vacuum  resin  infusion  process  is  done  is  shown  in  the 
figure  2 1 


Figure  21.  Finished  conventional  sandwich  composite  specimen 

The  final  sandwich  samples  are  cut  into  16  by  2  inch  pieces  and  are  glued  to  the  shear  jig 
by  structural  glue.  The  properties  of  the  structural  glue  have  been  previously  described 
while  explaining  about  the  shear  tests  on  foams.  Failure  was  observed  to  originate  at  the 
junction  of  the  fibreglass  skin  and  the  core.  Small  cracks  originated  at  yield  of  the 
samples  and  a  near  complete  delamination  of  the  skin  from  the  core  was  observed  at  the 
ultimate  load.  The  failure  observed  was  primarily  an  adhesive  debond  failure  as  can  be 
seen  from  the  debonded  surfaces  of  the  skin  and  the  core  in  figure  22.  However,  it  was 
also  observed  that  if  there  were  manufacturing  errors  such  as  improper  gluing  of  the 
sandwich  composite  sample  with  the  shear  jig,  such  that  the  structural  glue  instead  of  just 
being  attached  to  the  top  and  the  bottom  skin  surface  also  drips  along  the  side  and  gets  in 
contact  with  the  foam  and  hardens  in  certain  regions,  then  a  complete  delamination  of  the 
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skin  from  the  core  is  not  observed  instead  a  shear  failure  is  observed  in  the  foam  which 
then  propagates  into  the  skin  region  as  shown  in  figure  23. 


Figure  23.  Failure  observed  in  conventional  specimen  with  improper  bonding  to  the  jig 

It  was  also  observed  that  the  stress  strain  response  of  the  sample  varied  depending  on 
how  the  samples  were  manufactured  and  then  cut  for  the  test.  Once  the  VRI  process  was 
done,  the  samples  could  be  cut  either  along  the  direction  of  flow  of  resin  or  direction 
peri:»endicular  to  the  direction  of  flow  of  resin.  It  was  observed  that  higher  shear  stresses 
(approximately  16%  increase)  was  observed  for  samples  which  were  cut  along  the  408 
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direction  of  the  flow  of  resin  in  comparison  to  the  samples  cut  perpendicular  to  the 
direction  of  resin  flow. 


250 


Figure  24.  Variation  of  shear  response  considering  direction  of  specimen  cut  with  respect 
to  direction  of  resin  flow 

Manufacture  of  the  sandwich  composite  panel  with  shear  keys 

Theoretically  any  material  can  be  provided  as  a  shear  key.  The  advantage  of  the  shear  key 
would  be  to  help  prevent  adhesive  debonding  as  well  as  provide  better  strength  and 
stiffness  when  loaded  in  in-plane  shear.  The  manufacturing  techniques  of  inserting  in 
glass  fiber  shear  keys  in  the  sample  are  described  in  the  following  paragraph.  A  CNC 
machine  or  a  manual  mill  was  utilized  to  insert  grooves  in  the  foam  in  both  the  top  and 
bottom  side  as  shown  in  figure  25.  A  CNC  machine  can  be  programmed  to  create  any 
shape,  size  and  spacing  of  the  grooves  based  on  availability  of  drill  bits.  Semicircular 
grooves  of  diameter  8  mm  were  used  in  this  project. 


Figure  25.  Creation  of  grooves  in  the  foam  by  a  manual  mill 

A  number  of  different  materials  and  techniques  were  utilized  to  fill  up  the  grooves  in  the 
foam. 
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»  Process  1  -  The  first  layer  of  CSM  in  contact  with  the  foam  was  inserted  into  the 
groove  while  laying  the  fibreglass  layers  for  vacuum  resin  infusion  process.  The 
WR  layer  was  then  laid  over  the  grooves  in  the  foam.  The  grooves  were  then 
filled  up  by  CSM  strands  and  two  flat  layers  of  CSM  and  WR  were  laid  on  top  of 
it  so  as  to  create  a  flat  surface.  Vacuum  resin  infusion  was  done  along  the 
direction  of  the  grooves  to  manufacture  the  samples. 

«  Process  2  -  WR  strands  were  utilized  along  with  epoxy  resin  by  the  VRl  process 
to  make  semi  circular  prepregs  within  manufactured  aluminium/foam  molds  of 
same  dimension.  These  semicircular  prepregs  were  then  inserted  into  the  foam- 
core  grooves.  The  picture  of  the  aluminium/foam  mold  and  the  process  of 
manufacture  is  shown  in  figure  26. 


Figure  26.  Aluminum  and  Foam  molds  for  glass-fiber  prepregs;  VRl  process  of 
manufacture  of  the  prepreg  molds 

After  filling  up  the  foam-core  grooves  with  glass-fiber  with  any-one  of  the  above  process 
mentioned,  vacuum  resin  infusion  process  is  done  to  manufacture  the  sandwich 
composite.  A  final  product  done  using  process  2  is  shown  in  figure  27.  It  should  be  noted 
that  process  2  produced  better  and  consistent  results  in  comparison  to  process  1.  In 
process  1  there  are  more  possibilities  of  developing  voids  and  or  resin  rich  area  without 
fibers  at  the  interface  region  which  would  result  in  initiation  of  cracks  at  the  interface  of 
the  notch  and  the  foam.  Thereby,  process  2  is  being  recommended  as  the  process  of 
manufacture  of  the  samples  with  shear  keys. 

^ - 


Figure  27.  A  finished  sandwich  composite  specimen  with  shear  keys 


Different  types  of  samples  were  developed  utilizing  different  shape,  size  and  material  for 
filling  up  the  grooves.  The  samples  were  then  loaded  in  inplane  shear  and  responses 
obtained  were  compared  to  that  obtained  from  the  conventional  sandwich  composite  410 
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manufacturing  process.  It  should  be  noted  that  comparisons  are  being  made  with 
conventional  sample  in  which  the  specimen  is  cut  perpendicular  to  the  VRI  direction 
since  that’s  the  direction  in  which  VRI  is  applied  for  the  new  sandwich  composite 
constructions  with  shear  keys.  For  samples  with  shear  keys,  VRI  could  only  be  applied  in 
direction  perpendicular  to  the  cut  to  ensure  uniformity  of  the  shear  key  bonding  between 
the  glass-fiber  and  the  foam. 

A  strength  increase  of  approximately  25%  is  observed  with  introduction  of  8  mm 
diameter  semicircular  grooves  filled  with  prepreg  glass  fiber  manufactured  as  per  process 
2  (see  figure  28).  The  arrangement  of  the  grooves  is  such  that  the  bottom  shear-key  are 
centrally  placed  between  two  top  shear-keys. 

1.8 


Figure  28.  Comparison  of  mechanical  performance  in  shear  for  conventional  and  shear 
key  samples 

The  failure  observed  in  sample  with  shear  keys  is  shown  in  figure  29.  Even  though  the 
cracks  originate  at  the  interface  of  the  composite  skin  and  the  foam-core,  the  cracks 
deviate  at  the  shear  key  locations  and  a  shear  failure  is  observed  within  the  foam  core 
resulting  in  open  cracks  through  the  foam  core  depth  or  diagonal  shear  cracks.  It  should 
be  noted  in  this  context  that  this  method  of  introduction  of  shear  keys  can  be  utilized  in 
conjunction  with  other  established  methods  of  mechanical  performance  improvement 
such  as  stitching  and  z-pinning.  However,  the  mechanism  of  adding  in  shear  key  to 
sandwich  composites  is  a  robust,  cost  effective  means  by  which  the  mechanical 
performance  (especially  the  shear  capacity)  can  be  increased.  Before  establishment  of  this 
methodology  as  a  viable  alternative  to  stitching  and  z-pinning,  more  research  on  this 
methodology  is  warranted. 

Typically,  the  initiation  of  cracks  at  the  intersection  of  the  shear  key  in  the  grooves  to  the 
foam  is  a  result  of  high  stress  concentration  in  that  region.  This  can  properly  be 
controlled  with  better  manufacturing  and  also  creating  pre-grooved  foams  rather  than 
creating  groves  within  the  foams  after  they  have  been  made.  The  finite  element  study 
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shovv^s  the  differences  in  the  stress  pattern  with  and  without  the  grooves  filled  with  shear 
keys. 


Figure  29.  Failure  observed  in  samples  with  shear  keys  loaded  in  Inplane  shear 

Even  though  the  gain  in  shear  strength  was  significant  with  this  novel  methodology,  it 
was  observed  that  the  shear  keys  were  rigid  members.  Now  there  is  a  sharp  change  in 
stiffness  from  the  foam  to  the  glass-fiber  shear  keys  and  thereby  there  is  a  potentiality  of 
stress  concentration  in  those  regions.  In  order  to  prevent  this,  it  was  thought  of  as  how  to 
provide  less  stiffness  to  that  of  the  shear  keys  so  that  they  are  slightly  deformable. 
Thereby,  balsa  wood  was  provided  in  the  groves  to  act  as  shear  keys.  Gain  in  strength 
was  obtained  but  was  not  that  significant  in  comparison  to  the  previous  methodology,  as 
shown  in  figure  30.  It  was  also  observed  that  the  ductility  of  the  specimen  was  also 
comparatively  lower  with  the  balsa  specimen  in  comparison  to  the  prepreg  glass  fiber 
shear  keys  since  the  balsa  wood  itself  was  cracked.  It  should  be  noted  at  this  point  the 
density  of  balsa  wood  utilized  is  150  kgW,  which  is  not  significantly  different  from  the 
foam  sample  being  utilized  which  is  100  kg/m^. 
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2 


shear  strain  (angles  -  deg.) 

Figure  30.  Comparison  with  balsa  wood  shear  keys,  glass  fiber  shear  keys  and 
conventional  specimen 

Experimental  investigations  were  also  carried  out  for  samples  in  which  top  and  bottom 
shear  keys  are  just  placed  one  above  the  other  without  spacing  them  such  that  the  top 
keys  are  placed  in  between  two  bottom  keys  and  vice  versa.  It  was  observed  that  with 
spacing  gave  better  behavioral  response  with  regards  to  strength  and  ductility  in 
comparison  to  the  sample  without  the  spacing.  With  top  and  bottom  shear  keys  placed 
one  above  the  other,  a  necking  of  the  foam  core  material  is  observed  which  has  serious 
consequences  with  regards  to  failure.  It  can  be  observed  from  Figure  31  that  without 
spacing  samples  did  have  a  lower  strength  and  also  failed  faster  in  comparison  to  the 
spaced  ones,  which  is  obvious. 

2 


shear  strain  (angles  -  deg.) 


Figure  31.  Comparison  with  spaced  and  non-spaced  top  and  bottom  shear  key 
orientations 
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Experimental  investigations  were  also  performed  to  determine  the  effect  of  variation  of 
shape  of  the  grooves  in  the  foam.  One  of  the  grooves  in  the  sample  was  made  as  a  V 
notch.  Even  though  the  strength  of  the  two  samples  was  comparable,  however  the  V 
notch  sample  showed  rapid  degradation  of  strength  in  comparison  to  the  other 
semicircular  sample,  as  shown  in  Figure  32. 
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Conventional 

with  8  mm.  dia.  spaeed  semicircular 
glass-fiber  shear  keys 
with  8mm.  base  and  4  mm.  depth 
V  shaped  spaeed  glass  fiber  shear  key 


shear  strain  (angles  -  deg.) 

Figure  32.  Variation  with  different  shapes  of  the  foam-core  grooves  for  shear  keys 
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shear  strain  (angles  -  deg.) 

Figure  33.  Variation  with  different  sizes  of  shear  keys 


Experimental  investigation  was  also  carried  out  for  different  size  of  shear  keys  (Figure 
33).  The  one  in  which  it  was  16mm  spaeed  sample,  has  very  low  amount  of  foam  in 
between  the  two  faces  and  thereby  demonstrates  a  faster  failure  process.  This  elucidates 
that  there  is  a  limitation  to  the  ratio  of  the  shear  key  depth  to  the  foam  depth.  The  current  414 


NOOO 14-07-1- 1152 


Prepared  by  Dr.  N.  Mitra  -  May  2009 


P.l. Susan  C.  Opava,  Ph.D. 


investigation  just  highlights  the  limitation  without  being  able  to  recommend  the  limit. 
More  experiments  will  be  required  to  establish  the  limit. 

Finite  element  study 

The  simulated  discretized  specimen  with  loading  and  boundary  condition  is  shown  in 
figure  34.  Each  of  the  four  layers  in  the  top  and  bottom  skin  along  with  the  foam  core 
was  modelled  using  continuum  linear  brick  elements.  The  interface  between  the  skin  and 
the  core  was  modelled  as  a  perfect  surface-to-surface  tied  interface.  A  perfect  tied 
interface  was  also  utilized  to  model  connection  of  the  sandwich  composite  panel  with  the 
steel  shear  jigs.  As  shown  in  boundary  condition  in  figure  34,  one  end  of  the  steel  shear 
jig  was  fixed  against  translation  while  a  uniform  displacement  was  applied  at  the  other 
end. 


Figure  34.  Simulated  specimen  with  loading  and  boundary  conditions 


Good  correlation  with  regards  to  initial  stiffness  in  the  elastic  regime  could  be  observed 
between  simulated  and  experimentally  observed  composite  sandwich  composite  panel 
specimen  (as  shown  in  figure  35).  Differences  are  observed  in  the  post-yield  plateau 
region  for  the  experimental  and  simulated  specimen  because  of  limitations  in  the 
simulated  model.  In  the  experimental  model,  cracks  originate  at  the  interface  between  the 
skin  and  the  core  and  slipping  is  initiated  at  the  interface  region;  whereas  the  interface  in 
the  simulated  model  is  idealized  as  a  perfect  bond.  This  explains  the  lower  post-yield 
stress  of  the  experimental  model  in  comparison  to  the  simulated  model.  At  load 
increments  near  the  yield  branch  of  the  simulated  global  shear  stress-strain,  a  diagonal 
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distribution  of  normal  stresses  (cth)  are  observed  in  the  specimen  which  represent  a 
diagonal  shear  stress  failure  pattern;  the  stress  component  022  was  observed  to  be 
significantly  less  that  the  yield  tensile  stress  of  the  foam,  signifying  that  the  crack  pattern 
as  observed  in  figure  23  of  experimental  investigations  is  a  result  of  bad  manufacturing 
rather  than  the  failure  phenomenon.  A  low  value  CT22  in  the  foam  also  signifies  that  the 
failure  was  purely  an  adhesive  type  of  failure  and  the  response  obtained  in  figure  22  is  a 
correct  representation  of  the  behavioral  response.  Complex  damage  modeling  of 
tangential  slip  between  the  two  surfaces  in  contact  is  beyond  the  scope  of  the  current 
manuscript  and  would  be  addressed  in  later  publications.  Typical  stress  distributions 
observed  within  the  foam  in  simulations  of  the  conventional  sample  are  shown  in  figure 
36. 


Figure  35.  Comparison  of  the  global  response  of  the  conventional  composite  sandwich 
panel 

Simulated  sample  with  shear  keys  are  shown  in  figure  37.  An  increase  in  global  initial 
stiffness  with  introduction  of  shear  keys  is  observed  both  in  experimental  and  numerical 
simulations  as  shown  in  figure  38.  Typical  stress  distribution  of  the  specimen  with  shear 
keys  is  shown  in  figure  39.  It  was  observed  that  one  edge  of  the  foam  grooves  were 
subjected  to  compressive  loads  and  the  opposite  edge  were  subjected  to  in  tension.  High 
stress  concentrations  (cth  greater  than  the  tensile  strength)  are  observed  at  the  regions 
near  to  the  grooves  from  where  the  cracks  originate.  Similar  behavior  has  also  been 
observed  in  cracks  observed  from  experimental  investigations  in  figure  29.  Figure  29  also 
demonstrate  cracks  observed  at  the  interface  region  of  the  skin  and  the  core;  however 
since  a  fully  tied  interface  is  modeled  in  the  simulated  specimen  this  feature  could  not  be 
captured  in  the  simulated  observations.  Plastic  strain  (PEEQ)  plots  (figure  40)  for  the 
shear  key  specimen  demonstrates  development  of  plasticity  within  the  foam  region.  It 
should  be  noted  that  no  plasticity  response  could  be  obtained  in  the  conventional 
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specimen.  This  demonstrates  that  the  plastic  nature  of  foam,  not  utilized  in  the 
conventional  methodology,  could  be  utilized  in  the  proposed  approach  of  introduction  of 
shear  keys. 
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Figure  36.  Typical  stress  distribution  in  the  foam  for  the  conventional  specimen 


417 


shear  stress  (Mpa) 


NOOO 14-07-1-1 152 


Prepared  by  Dr.  N.  Mitra  -  May  2009 


P.l. Susan  C.  Opava.  Ph.D. 


I _  ‘  - _ j 


Figure  37.  Simulated  sample  with  shear  keys 
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Figure  38.  Initial  stiffness  increase  with  introduction  of  shear  keys 
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Figure  39.  Stress  distribution  in  sample  with  shear  keys 
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PEEQ 
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Figure  40.  Equivalent  plastic  strain  plot  of  the  grooved  foam  in  proposed  methodology 


Concluding  remarks 

The  manuscript  demonstrates  that  introduction  of  shear  keys  in  a  conventional  sandwich 
sample  is  a  cost  effective  novel  methodology  which  results  in  increase  in  initial  stiffness 
and  strength  of  the  inplane  shear  response  of  composite  sandwich  panels.  More  research 
is  required  to  establish  this  as  a  viable  technique  similar  to  stitching  and  z-pinning. 
Numerical  simulations  were  performed  and  areas  of  improvement  such  as  constitutive 
modeling  of  foam  and  damage  modeling  of  the  interface  were  identified  for  future  work. 
It  is  being  hypothesized  that  this  mechanism  of  adding  in  “shear  keys”  would  also  be 
useful  as  a  “peel  stopper”  mechanism  to  prevent  delamination  of  skin  from  the  core.  To 
demonstrate  the  feasibility  of  the  hypothesis  a  number  of  experimental  investigations 
have  been  devised  and  currently  being  pursued. 
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U.S.-China  Collaborative  Soil-Structure-Interaction  Research 

By  PI  Robb  Moss,  PhD,  PE 

Introduction 

This  research  involves  shake  table  testing  of  scale  soil-structure  models  that  mimic  the  coupled 
seismic  response  of  underground  structures  and  the  soil  surrounding  the  underground 
structures  (termed  soil-structural-interaction  or  SSI).  Currently  the  design  of  subways  and  other 
critical  underground  infrastructure  relies  on  little  to  no  empirical  data  for  calibrating  numerical 
simulations.  This  research  is  working  towards  filling  that  empirical  data  gap.  This  project  is  also 
being  used  as  a  vehicle  to  establish  a  joint  testing  program  between  Nanjing  University  of 
Technology  (NJUT)  and  Cal  Poly.  Professor  Zhihua  Wang  from  NJUT  is  participating  in  the 
project  both  here  at  Cal  Poly  as  a  visiting  researcher  and  remotely  from  Nanjing.  The  scale 
model  testing  equipment  designed  for  this  type  of  shake  table  testing  was  provided,  via  an 
indefinite  loan  agreement,  by  U.C.  Berkeley.  The  long  term  objective  is  to  fully  develop  a  scale 
model  testing  platform  for  evaluating  seismic  stability  of  all  manner  of  critical  underground  and 
above  ground  infrastructure.  Seismic  stability  in  most  cases  can  be  related  to  post-impact  or 
explosive  force  stability  assessment  which  is  an  immediate  interest  for  military  and  national 
security. 

Project  Significance 

There  are  many  poorly  understood  seismic  issues  associated  with  critical  infrastructure  in 
seismic  areas  of  the  U.S.  and  China.  The  U.S.  has  aging  infrastructure  such  as  bridges, 
subways,  and  buildings  that  were  designed  based  on  older  seismic  criteria  that  do  not 
necessarily  capture  the  full  dynamic  response  that  is  now  anticipated.  The  U.S.  also  has  new 
infrastructure  being  planned  or  built  that  may  be  limited  in  the  scope  of  design  because  of 
unanswered  seismic-soil-interaction  (SSI)  questions.  China  is  trying  to  keep  pace  with  its 
rapidly  developing  economy  by  building  infrastructure  at  a  frantic  pace.  However  the  seismic 
design  understanding  and  seismic  codes  are  not  necessarily  keeping  up  with  the  pace  of 
development.  This  research  seeks  to  establish  a  parallel  testing  platform  that  could  be  used 
simultaneously  by  researchers  at  Cal  Poly  and  at  Nanjing  University  of  Technology  (NJUT),  Cal 
Poly’s  sister  university  in  the  Jiangsu  province  of  China  while  addressing  the  seismic  research 
needs. 

Recent  research  has  shown  that  there  is  uncertainty  in  the  dynamic  response  of  soil  sites 
(Bazzurro  and  Cornell  2004)  and  the  coupled  response  of  structure  above  and  below  the  ground 
surface  and  the  surrounding  or  supporting  soils  (Hashash  et  al.  2001;  Stewart  et  al.  1999). 
Some  examples  of  U.S.  infrastructure  that  warrant  SSI  research  include:  elevated  highways, 
underground  light  rail  and  subways,  bridges,  overpasses,  water  canals,  water  supply  tunnels, 
pipelines,  levee  systems,  and  dams.  Research  into  the  dynamic  response  of  U.S  infrastructure 
would  mainly  address  seismic  integrity,  seismic  hazard  mitigation,  and  seismic  retrofit.  In  China 
the  infrastructure  that  warrants  SSI  research  is  similar  in  scope  but  generally  dealing  with  initial 
planning  and  design. 

The  provincial  government  of  Jiangsu  province  has  declared  Geotechnical  Engineering  as  the 
primary  research  focus  of  the  next  decade  (initiated  in  2006).  This  is  due  to  the  large  amount  of 
infrastructure  being  planned  and  built  (bridges,  subways,  highways,  large  buildings, 
underground  facilities)  to  accommodate  the  rapid  development  in  the  province.  Research 
money  is  being  pumped  into  the  provincial  universities  with  NJUT  garnering  a  large  portion 
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because  of  their  reputation  as  an  outstanding  geotechnical  research  facility.  The  NJUT 
geotechnical  group  is  in  turn  reaching  out  to  U.S.  researchers  to  augment  their  research 
expertise  in  order  to  “jump  start”  their  efforts.  Collaboration  between  NJUT  and  Cal  Poly  was 
established  within  the  last  four  years  with  emphasis  placed  on  earthquake  engineering  which  is 
a  strong  common  asset  at  both  institutes.  This  proposal  is  the  culmination  of  recent  efforts  to 
initiate  research  exchange  that  will  benefit  both  the  universities  and  their  supporting 
communities. 

Testing  Platform 

In  physical  testing,  and  scale  model  testing  in  particular,  the  testing  equipment  and  physical 
model  details  can  demand  the  bulk  of  the  research  effort  and  this  project  is  no  exception.  The 
first  year  of  this  project  was  spent  acquiring  the  necessary  materials/supplies, 
building/modifying/manufacturing  the  testing  equipment,  and  calibrating  the  testing  platform  to 
achieve  the  desired  results.  To  carry  out  scale  model  tests  on  the  shake  table,  similitude 
analysis  dictates  the  scaling  of  important  variables  like  dynamic  soil  strength,  dynamic  structural 
response,  and  associated  displacements.  The  scaling  analysis  of  the  soil  and  structural 
elements  will  follow  the  research  by  Meymand  (1998)  which  used  the  San  Francisco-Oakland 
Bay  Bridge  and  Bay  Mud  as  the  prototype  structure  and  soil.  PI  Robb  Moss  was  involved  in  this 
research  at  Berkeley  during  his  doctoral  work  and  has  other  experience  running  scale  model 
testing  from  his  Master’s  research. 

The  testing  platform  used  for  this  research  was  acquired,  on  indefinite  loan,  from  UC  Berkeley. 
The  main  piece  of  testing  equipment  is  a  flexible  wall  barrel  that  mimics  free  field  seismic  site 
response  when  subjected  to  strong  shaking  on  the  shake  table.  Validation  of  the  testing 
platform  involved  comparing  analytical  results  with  recorded  response  from  the  flexible  wall 
barrel  and  scaled  structural  element.  Figures  1  and  2  show  the  validation  from  Meymand 
(1998)  demonstrating  the  dynamic  performance  of  the  flexible  barrel  versus  other  testing 
containers.  As  can  be  seen  the  flexible  wall  barrel  provides  the  most  accurate  representation  of 
seismic  soil  response  with  respect  to  the  prototype. 
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Figure  1.  Previous  research  by  Meymand  (1998)  examined  different  modei  soil  containers  for  SSI 
shake  table  testing. 
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Figure  2.  Dynamic  analysis  of  different  model  soil  containers.  The  spectral  response  results 
above  show  that  the  flexible  wall  barrel  provides  the  most  realistic  response  when  compared  to 
prototype  field  conditions. 

The  flexible  wall  barrel  assembly,  associated  miscellaneous  equipment,  and  a  large  volume  soil 
mixer  was  acquired  on  indefinite  loan  from  the  Richmond  Field  Station  at  UC  Berkeley.  This 
equipment  had  been  sitting  “moth  balled”  for  a  decade  since  PI  Robb  Moss  packed  it  away 
following  the  demise  of  a  state  funded  research  project  (a  victim  of  Bay  Bridge  politics).  Once 
transport  of  the  equipment  to  Cal  Poly  was  accomplished  the  equipment  was  in  need  of 
refurbishment  and  modification  to  fit  the  shake  table  at  Cal  Poly  in  the  Parsons  Earthquake  Lab. 
The  equipment  was  refurbished,  supporting  equipment  purchased  and/or  manufactured,  and  the 
bucket  assembled  on  the  shake  table.  The  next  step  was  to  begin  the  manufacture  of 
appropriate  soil  to  run  the  scale  model  tests.  Figure  3  shows  the  flexible  wall  barrel  assembled 
on  the  shake  table  awaiting  soil.  Figure  4  shows  the  filling  of  the  barrel  and  Figure  5  shows  the 
full  barrel  awaiting  seismic  testing. 

The  scale  model  test  soil  for  these  tests  adheres  to  similitude  analysis  to  ensure  properly  scaled 
response.  The  geometry  scale  of  these  tests  will  be  10”’  scale  which  is  equivalent  to  the  overall 
similitude  scale  A.  In  similitude  analysis  it  is  not  possible  to  scale  all  the  physical  parameters 
simultaneously.  For  this  research  dynamic  strength  of  the  soil  was  chosen  as  the  primary 
physical  parameter  to  model  and  the  model  soil  was  designed  accordingly.  A  mix  of  kaolinite, 
bentonite,  fly  ash,  and  water  was  used  in  specific  proportions  to  achieve  the  desired  strength 
range.  The  mix  used  was  at  110%  water  content  and  the  target  undrained  strength  of  Su=4  kPa 
from  a  UU  (undrained  unconfined)  triaxial  test  was  used  as  the  guide  prior  to  large  volume  soil 
mixing.  Once  in  the  barrel  T-bar  pull  out  tests  and  shear  wave  velocity  tests  measure  the  in  situ 
soil  strength  for  each  phase  of  the  seismic  testing. 
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Figure  3.  Testing  platform  showing  the  shake  table  with  the  flexible  wall  barrel  Installed.  The 
flexible  wall  barrel  is  composed  of  the  four  corner  posts  with  universal  joints  at  the  top  and 
bottom,  top  and  bottom  rings,  and  the  barrel  wall.  The  wall  is  composed  of  a  6.4  mm  thick  rubber 
membrane  which  is  confined  by  45  mm  wide  Kevlar  straps  spaced  on  center  every  60  mm.  The 
(yellow)  mixer  on  the  left  is  used  to  mix  large  volumes  of  model  soil  (composed  of  kaolinite, 
bentonite,  fly  ash,  and  water)  for  filling  the  barrel. 


Figure  4.  Process  of  filling  the  barrel  with  scale  model  soil  is  shown.  Ten  accelerometers  were 
placed  within  the  soil  in  both  vertical  and  horizontal  arrays  to  measure  the  dynamic  response  of 
the  soil  during  seismic  shaking. 
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Figure  5.  Full  barrel  being  prepared  for  initial  calibration  tests.  Notice  cross  braces  are  still  in 
place  and  will  be  removed  prior  to  testing  to  allow  the  flexible  barrel  free  movement  in  response 
the  imposed  seismic  shaking. 


Phase  1  Tests 

The  first  phase  of  the  seismic  testing  is  to  perform  free-field  tests,  that  is  tests  without  an 
embedded  structure.  This  will  determine  the  dynamic  response  of  the  soil  column  without  the 
influence  of  the  underground  structure  and  provide  a  baseline  for  evaluating  the  effects  of  the 
soil  on  the  structure.  The  input  ground  motions  selected  for  the  base  input  are; 

1.  1979  Imperial  Valley,  El  Centro  motion 

2.  1992  Landers,  Joshua  Tree  motion 

3.  1999  Chi  Chi,  TCU075  motion 

These  motions  were  selected  specifically  to  impose  large  adverse  loads  on  an  underground 
structure  and  because  these  were  the  same  motions  selected  and  peer  reviewed  for  analogous 
tunnel  related  consulting  projects.  To  adhere  to  the  similitude  analysis  the  time  must  be  scaled 
at  A°  ®  to  provide  the  correct  dynamic  response.  This  means  the  time  step  of  the  ground  motions 
must  be  compressed  to  At/  These  motions  were  also  corrected  for  full  ground  reflection 
because  they  were  recorded  at  the  ground  surface  and  need  to  be  used  as  base  level  motions. 
This  was  accomplished  by  modifying  the  motions  using  SHAKE  (SHAKE91  Idriss  and  Sun  92) 
to  subtract  the  full  reflection  of  an  “outcrop”  motion  to  render  a  “within”  motion  with  respect  to 
the  prototype  soil  profile. 

Instrumentation  for  the  tests  includes  10  accelerometers,  3  displacement  transducers,  a  load 
cell,  and  a  digital  video  capture  that  will  be  analyzed  using  image  processing  techniques  to 
resolve  displacement  with  time.  Static  soil  strength  tests  conducted  before  and  after  shaking 
tests  will  include  shear  wave  velocity  measurements  and  T-bar  pull  out  tests. 

Numerical  modeling  of  the  tests  will  be  accomplished  using  codes  that  will  model  1-D  equivalent 
linear  response,  2-D  equivalent  linear  response  with  structural  elements,  and  fully  nonlinear 
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response  with  structural  elements.  SHAKE  (SHAKE91  Idriss  and  Sun  92)  will  be  used  to 
properly  model  the  1-D  equivalent  linear  response  of  the  free-field  prototype  conditions.  Results 
from  the  accelerometer  arrays  should  agree  closely  with  the  SHAKE91  results  and  will  provide 
calibration  for  the  subsequent  numerical  modeling. 


Phase  2  Tests 

An  underground  section  of  the  BART  (Bay  Area  Rapid  Transit)  light  rail  was  chosen  as  the 
prototype  for  the  SSI  tests.  This  structure  is  also  similar  to  light  rail  tunnels  being  considered  in 
the  Jiangsu  province.  PI  Robb  Moss  has  had  several  consulting  projects  related  to  SSI  analysis 
of  the  BART  light  rail  and  most  relevant  an  analysis  of  an  underground  design  for  the  so  called 
Warm  Springs  Extension.  The  consulting  experience  on  this  project  and  similar  projects 
provides  strong  guidance  on  the  current  research  needs. 

A  scale  model  structure  will  be  assembled  adhering  to  the  similitude  scaling  of  the  structural 
stiffness  of  the  BART  tunnel  cross  section.  Of  primary  research  and  design  interest  is  the 
“racking”  of  the  structure  or  the  relative  displacement/drift  of  the  top  of  the  tunnel  section  with 
respect  to  the  bottom  of  the  tunnel  section.  This  tends  to  be  the  critical  cross  sectional  design 
variable  for  underground  tunnels  undergoing  seismic  SSI  in  soils.  We  anticipate  instrumenting 
the  model  cross  section  with  displacement  measurement  devices  (an  LVDT,  strain  gage,  or 
displacement  transducer)  to  measure  these  displacements. 

Numerical  modeling  of  Phase  2  will  use  the  SHAKE  results  as  a  baseline  but  will  use  codes  that 
can  accommodate  structural  elements.  FLUSH  (Lysmer  et  al.  1975)  will  be  used  to  perform  2-D 
equivalent  linear  analysis  with  the  inclusion  of  the  embedded  structure  to  provide  SSI  analysis 
of  the  prototype  soil  profile  with  the  subway  cross  section.  The  free-field  response  will  be 
calibrated  using  SHAKE  results  and  then  structural  “racking"  strains  will  be  documented  using 
this  code.  A  similar  numerical  analysis  will  be  performed  using  the  fully  nonlinear  code 
ABAQUS  (Simulia  2009)  to  capture  any  highly  non-linear  response  that  is  missed  using  an 
equivalent  linear  approach. 

NJUT  Participation 

Professor  Zhihua  Wang  from  NJUT  joined  the  project  spring  of  2008  and  was  a  visiting  scholar 
at  Cal  Poly  for  over  six  months.  In  that  time  he  participated  in  project  meetings  and  worked  on 
the  fully  nonlinear  numerical  analysis  using  ABAQUS  to  provide  insight  into  the  dynamic 
response  of  the  soil  column  and  the  underground  subway  cross  section.  He  has  since  returned 
to  Nanjing  but  continues  to  work  on  the  numerical  analysis  in  Nanjing.  As  testing  progresses  to 
Phase  2  our  interaction  will  intensify  as  the  comparison  of  equivalent  linear  and  nonlinear 
results  will  provide  very  useful  information  on  measured  response  from  the  shake  table  testing. 
Prof  Wang  also  provided  a  detailed  literature  review  of  SSI  shake  table  testing  in  China  which 
allows  this  project  to  have  a  comprehensive  review  of  all  SSI  testing  that  exists  in  English  and 
Mandarin. 

NJUT  is  currently  developing  a  concurrent  shake  table  testing  program  looking  at  SSI  related 
problems.  The  interaction  between  Cal  Poly  and  NJUT  will  provide  strength  to  both  research 
programs  and  will  allow  for  easy  collaboration  between  researchers.  The  long  term  goal  is  to 
have  parallel  testing  that  can  address  specific  SSI  issues  in  a  concerted  manner.  Having 
visiting  faculty  like  Prof  Wang  will  go  a  long  way  towards  the  goal  of  ongoing  collaboration. 
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Student  Researchers 

This  project  currently  employs  one  graduate  student  researcher  and  two  undergraduate  student 
researchers.  The  funding  will  carry  the  graduate  student,  Vic  Crosariol,  through  his  graduate 
career  here  at  Cal  Poly.  There  are  plans  to  carry  one  of  the  undergraduate  researchers,  Steven 
Kuo,  over  into  a  masters  degree  drawing  on  the  valuable  training  that  he  has  gained  through 
this  research.  Employment  of  student  researchers  is  an  asset  to  this  project,  the  College  of 
Engineering,  and  Cal  Poly  in  general.  This  form  of  “learning  by  doing”  is  invaluable  at  many 
levels  and  ultimately  results  in  pushing  the  field  of  seismic  geotechnics  forward  through 
innovative  research.  In  addition  to  research  Vic  has  been  able  to  provide  lecturer  support  acting 
as  an  instructor  in  undergraduate  soil  mechanics  labs. 

Summary 

This  report  provides  a  description  of  the  project  funded  by  ONR  through  the  C^RP  program  at 
Cal  Poly.  The  research  objective  is  to  provide  empirical  data  on  the  soil-structure-interaction 
between  underground  structures  and  the  surrounding  soil  during  seismic  ground  shaking,  an 
area  where  little  to  no  usable  data  exists  for  calibrating  numerical  analysis.  To  that  end  a 
testing  platform  has  been  developed  drawing  on  prior  similar  research.  The  testing  platform 
consists  of  a  flexible  wall  barrel  that  can  fully  articulate  during  excitation  on  the  shake  table  that 
is  located  in  the  Parsons  Earthquake  Lab  at  Cal  Poly.  Phase  1  of  the  testing  is  nearing 
completion  which  included  the  difficult  task  of  acquiring,  manufacturing,  and  assembling  the 
scale  model  testing  platform.  Free-field  testing  of  the  platform  is  currently  being  conducted. 
Phase  2  of  the  testing  will  be  to  install  a  scale  model  underground  structure  and  determine  the 
dynamic  response  of  the  structure  with  respect  to  the  soil.  This  project  is  being  used  as  an 
opportunity  to  develop  a  joint  testing  program  between  NJUT  (Nanjing,  China)  and  Cal  Poly.  A 
professor  from  NJUT  has  been  a  visiting  scholar  on  this  project  and  continues  to  provide 
support  through  numerical  modeling.  This  research  is  focused  on  seismic  response  but  the 
results  are  easily  translatable  to  military  and  national  security  issues  related  to  the  resilience  of 
critical  infrastructure.  Ultimately  we  will  have  a  complete  suite  of  test  results  showing  free-field 
and  SSI  (soil-structure-interaction)  response.  The  results  will  provide  a  data  set  for  calibrating 
numerical  SSI  models  and  provide  a  strong  basis  for  justifying  “racking”  deformations  of 
underground  tunnels  for  seismic  design. 
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FINAL  REPORT  AND  SUMMARY  OF  RESULTS 
Implementation  and  Evaluation  of  Physiologic  Conditions  for  a  High  Throughput 

“Blood  Vessel  Mimic”  Model  System 
Kristen  O’Halloran  Cardinal,  PI 
Department  of  Biomedical  and  General  Engineering 

Introduction  and  Use  of  Funds 

This  C3RP  grant  was  focused  on  developing  and  implementing  physiologic  conditions 
within  an  engineered  in  vitro  human  blood  vessel  construct.  This  human  blood  vessel  construct, 
or  “blood  vessel  mimic”  (BVM),  is  being  developed  for  use  as  a  high-throughput,  living  model 
for  preclinical  evaluation  of  new  intravascular  technologies.  A  successful  physiologic  vessel 
model  has  potential  uses  for  device  and  therapeutic  evaluation  as  well  as  for  development  of 
diagnostic  technologies  to  treat  or  assess  cardiovascular  conditions  related  to  disease  or  trauma. 
The  capability  to  design  and  develop  better  technologies  and  better  devices  will  lead  to  better 
care  of  injured  civilians  and  soldiers.  The  vessel  model  could  also  potentially  be  used  to 
evaluate  the  effect  of  circulating  toxins,  pathogens,  or  chemical  agents  on  human  vascular  cells. 

Previous  work  established  methods  for  creating  a  blood  vessel  mimic  composed  of 
expanded  polytetrafluoroethylene  (ePTFE)  tubular  scaffolds  lined  with  human  microvessel 
endothelial  cells.  This  vessel  mimic  had  been  successfully  used  to  evaluate  the  endothelial  cell 
response  to  intravascular  stents.  However,  certain  limitations  of  this  model  existed,  including  a 
non-physiologic  low-shear  flow  environment,  and  use  of  an  expensive,  off-the-shelf  polymer 
scaffold  with  non-native  mechanical  properties.  Thus,  the  focus  of  this  project  was  to  improve 
the  vessel  model  by  addressing  these  key  limitations. 

In  order  to  develop  a  more  physiologic  vascular  model,  this  project  attempted  to  answer 
several  key  questions.  Can  we  incorporate  physiologic  flow  conditions  and  an  appropriate, 
customizable  scaffold  with  the  current  high-throughput,  cost-efficient  vessel  mimic?  How  will 
these  components  influence  the  resulting  vessel  structure  and  morphology?  In  order  to  answer 
these  questions,  two  main  aims  were  proposed.  The  first  aim  was  to  develop  and  implement 
physiologic  flow  conditions  within  individual  vessel  systems.  Proposed  methods  included 
modification  of  nutrient  medium  to  increase  viscosity,  and  configuration  of  new  pumps  and  new 
bioreactor  systems  to  induce  pulsatile  flow.  The  second  aim  was  to  develop  and  implement  a 
scaffold  with  appropriate  mechanical  properties  that  would  support  vascular  cell  cultivation  and 
growth  in  vitro.  Proposed  methods  included  in-house  creation  of  both  protein-based  and 
polymer-based  vessel  scaffolds. 

Funds  for  this  project  were  utilized  to  purchase  the  supplies  necessary  to  perform 
experimental  work,  as  well  as  for  travel  and  compensation  for  those  involved  in  the  project. 
Overall,  as  outlined  in  the  proposal,  funds  were  used  in  the  following  ways: 

>  To  purchase  supplies  summarized  below: 

o  Flow  Experiments:  pump  drive,  clamps,  tubing,  fittings,  valves,  bioreactor 
chambers,  media,  dextran,  methylcellulose 
o  Scaffold  Experiments:  collagen  reagents,  decellularization  chemicals, 
mandrels,  polymers,  solvents 

o  Cell  Culture  and  Assessment:  cells,  media,  supplements,  flasks  and 
disposables,  staining  reagents 

>  To  pay  for  ethylene  oxide  and  autoclave  sterilization  services  from  the  Cal  Poly  Vet 
Clinic,  in  order  to  ensure  living  vessels  were  set  up  sterilely. 
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r-  To  support  student  travel  to  the  annual  Biointerface  Conferenee  in  Minneapolis,  MN 
for  students  to  present  posters  of  their  work  to  medieal  deviee  industry  members  and 
researchers,  as  well  as  to  partially  support  my  travel  to  the  annual  Tissue  Engineering 
and  Regenerative  Medieine  International  Soeiety  meeting  to  present  results. 

>•  To  provide  eompensation  for  myself  during  the  summer  to  be  able  to  foeus  my  time 
and  researeh  efforts  on  training  students  and  performing  experiments  as  part  of  this 
projeet  and  to  provide  eompensation  for  students  dedieating  themselves  to  this  projeet 
(whieh  ultimately  led  to  additional  uneompensated  student  partieipation). 


Summary  of  Work  Aeeomplished  and  Results 

As  summarized  above,  the  two  key  aims  of  this  work  included  implementation  of 
physiologie  flow  eonditions  and  physiologic  scaffold  materials  into  an  in  vitro  tissue  engineered 
blood  vessel  mimic  model  system.  These  aims  led  to  work  being  divided  into  two  tasks,  eaeh  of 
which  is  outlined  below,  followed  by  a  summary  of  data  generated  and  results. 

Task  1:  Physiologic  Flow 

FToposed  Hypothesis:  Physiologie  flow  conditions  ean  be  implemented  by  inereasing 
viseosity  and  by  indueing  pulsatility  through  speeifie  pump  and  bioreaetor 
eonfigurations.  Endothelial  eells  within  the  vessel  mimics  will  withstand  these 
conditions. 

>  Proposed  Procedures:  Completing  this  task  will  involve  altering  media  to  inerease 

viseosity  and  reeonfiguring  bioreaetor  systems  to  support  pulsatile  flow.  Work  will  begin 
v/ith  preliminary  researeh  and  literature  searches  regarding  bioeompatible  media 
thiekeners,  and  will  eontinue  with  bioreaetor  modifieations  primarily  to  the  pump  head 
and  flow  path.  Studies  will  conclude  by  assessing  the  ability  of  cells  to  withstand  flow 
modifieations. 

Task  1  Data  and  Results: 

Increasing  Media  Viscosity  for  More  Physiologic  Shear  Stress 

Following  a  review  of  the  literature,  dextran  and  methyleellulose  were  identified  as 
possible  media  supplements  with  potential  to  inerease  media  viseosity  to  more  physiologic 
levels.  After  initial  testing,  it  was  found  that  methyleellulose  did  not  dissolve  readily  in  media, 
and  thus  dextran  was  pursued  as  our  media  supplement.  Various  concentrations  of  dextran  were 
added  to  media,  and  viscosity  was  measured  with  a  viscometer.  Measured  viseosity  was  then 
used  to  ealeulate  resultant  shear  stress  in  a  4mm  diameter  tubular  vessel  based  on  the  equation: 

Twall  =  32pQ/7TD^ 

where  p  is  the  measured  viscosity,  Q  is  the  flow  rate,  and  D  is  the  seaffold  diameter.  Based  on 
literature,  our  target  physiologie  shear  stress  was  in  the  range  of  6-12  dyne/em^,  as  this  level  of 
shear  stress  has  been  shown  to  induee  proper  endothelial  eell  alignment  and  morphology. 
Caleulated  shear  stresses  in  a  4mm  diameter  BVM  with  different  dextran  concentrations  and  at 
various  flow  rates  are  shown  in  Figure  1  below.  Highlighted  in  green  are  eombinations  of  flow 
rate  and  dextran  concentration  that  lead  to  shear  stresses  in  a  physiologie  range. 
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Figure  1:  Calculated  shear  stresses  in  a  4mm  BVM  based  on  flow  rate  and  %  dextran 


Based  on  these  results,  a  static  experiment  was  performed  to  assess  the  impact  of  high 
concentrations  of  dextran  on  endothelial  cell  culture.  It  was  determined  that  concentrations 
above  20%  led  to  endothelial  cell  death.  Ultimately,  a  concentration  of  14%  dextran  was 
identified  as  an  ideal  concentration  that  would  support  physiologic  wall  shear  stress  at  an 
appropriate  flow  rate,  without  inducing  cytotoxic  effects. 


Modifying  Bioreactor  Systems  to  Support  Pulsatile  Flow 

The  previous  BVM  bioreactor  system  consisted  of  a  bioreactor  chamber  and  media 
reservoir  connected  by  tubing  across  an  8-roller  peristaltic  pump.  This  system  configuration  led 
to  relatively  steady  flow,  which  is  not  representative  of  the  pulsatile  environment  in  vivo. 
Therefore  various  bioreactor  configurations  were  built  using  a  range  of  valves,  clamps,  and 
tubing  in  an  attempt  to  induce  physiologic  pressure  fluctuations.  A  3-roller  pump  head  was 
purchased  and  implemented  to  more  closely  match  pulsatile  conditions.  Results  from  testing 
different  configurations  led  to  the  development  of  the  modified  bioreactor  system  shown  below 
in  Figure  2. 


Figure  2:  Original  bloreactor  system  (left)  compared  with  reconfigured  bloreactor  system 
(right).  New  system  incorporates  a  3-roIIer  pump  head  and  additional  tubing  components 
to  induce  more  physiologic  pulsatile  flow  with  pressure  fluctuations. 
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The  new  bioreactor  design  incorporated  a  minimal  number  of  ehanges  and  maintained  the 
simplicity  required  for  scaling  up  the  system.  Bioreactor  flow  conditions  were  characterized  by 
measuring  flow  rates  corresponding  to  RPM  settings,  and  by  using  an  AD  Instruments  LabChart 
Data  Acquisition  System  to  monitor  pressure  fluctuations.  Results  from  the  original  system  as 
compared  with  results  from  the  new  system  are  provided  in  Figure  3. 
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Figure  3:  Original  bioreactor  system  induced  relatively  steady,  non-physiologic  flow 
conditions  characterized  by  baseline  “noise”  pressure  fluctuations  (top  panel).  Tbe 
modified  bioreactor  system  produced  more  physiologic  pressure  fluctuations  mimicking 
pulsatile  flow  in  the  arteries  (bottom  panel). 

These  results  demonstrate  that  it  is  possible  to  configure  our  BVM  bioreactor  systems  to 
incorporate  more  physiologic  flow  conditions.  Although  there  is  no  back  pressure  in  the  new 
system,  the  magnitude  of  pressure  fluctuation  appropriately  reflects  the  fluctuation  in  vivo,  as 
docs  the  frequency  of  pulsation. 

Assessing  Potential  for  BVM  Cultivation  under  Physiologic  Flow  Conditions 

Based  on  results  from  viscosity  and  pulsatility  studies,  it  was  necessary  to  determine  if 
and  how  endothelial  cells  sodded  within  a  BVM  would  respond  to  the  new  flow  conditions. 
Separate  studies  were  performed  to  determine  if  human  umbilical  vein  endothelial  cells 
(HUVECs)  sodded  onto  the  lumen  of  an  ePTFE  scaffold  could  withstand  increased  shear  stress 
(using  a  14%  dextran  media  recipe)  or  enhanced  pulsatility  (using  the  new  bioreactor 
configuration),  and  if  so-  to  determine  the  effect  that  these  conditions  would  have  on  subsequent 
lumen  morphology.  Results  from  these  studies  indicated  that  HUVECs  do  in  fact  maintain 


434 


NOOO 14-07-1-1 152 


P.I. Susan  C.  Opava,  Ph.D. 


luminal  adhesion  following  implementation  of  the  new  flow  conditions.  These  results  are 
illustrated  by  the  positive  fluorescent  nuclear  staining  seen  below  in  Figure  4. 


I 

I 


100X  100X 


Figure  4:  HUVECs  sodded  onto  the  lumen  of  ePTFE  scaffolds  maintained  adhesion 
following  implementation  of  pulsatile  flow  conditions  (left  image)  and  with  increased 
viscosity  (right  image). 


However,  examination  of  the  morphology  of  these  cellular  linings  revealed  that  HUVECs  do  not 
form  an  elongated,  confluent  lining  as  expected.  Several  factors  may  be  relevant  to  why  this 
occurred,  including  the  amount  of  growth  factor  present  in  the  media,  the  cell  sodding  density, 
and  the  flow  ramp-up  protocols.  Future  work  will  be  necessary  to  explore  these  factors  in  order 
to  develop  appropriate,  elongated  luminal  morphology. 


Task  2:  Compliant  Scaffolds 

>  Proposed  Hypothesis:  A  compliant  scaffold  can  be  developed  that  will  support  formation 
of  a  more  physiologic  vessel  structure  as  compared  with  existing  vessel  mimics. 

>  Proposed  Procedures:  Completing  this  task  will  involve  developing  scaffold  protocols, 
evaluating  properties  of  new  scaffold  materials,  and  testing  cell  compatibility.  Initial 
work  will  be  focused  on  pursuing  two  potential  scaffolds:  collagen  (biologic)  and 
polyurethane  (synthetic),  which  have  both  shown  relatively  good  compliance  in  previous 
literature.  Protocols  will  be  implemented  and  fabricated  materials  will  be  tested. 

Task  2  Data  and  Results: 

Developing  Biologic  Vessel  Scaffolds 

Initial  efforts  were  aimed  at  developing  a  biologic  collagen  scaffold  to  replace  the  ePTFE 
that  is  used  in  the  BVM.  The  rationale  was  that  a  biologic  scaffold  would  more  closely  match 
physiologic  mechanical  properties,  and  that  collagen  in  particular  would  match  the  typical 
extracellular  matrix  component,  thus  leading  to  a  more  representative  vessel  model.  Initial 
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studies  involved  designing  and  fabricating  tubular  molds  that  were  used  to  form  collagen  into  a 
polymerized  tube.  Although  proper  dimensions  were  attainable,  and  collagen  polymerization 
protocols  were  successfully  implemented,  resultant  tubes  clearly  lacked  the  mechanical  integrity 
ncccssan/  for  BVM  application.  The  collagen  tubes  even  lacked  sufficient  structure  to  allow 
mechanical  testing.  Therefore,  other  options  for  creating  a  protein  based  scaffold  were  explored. 

Literature  review  and  further  research  resulted  in  the  identification  of  deccllularization  as 
a  consistent,  established  procedure  with  potential  for  creating  tubular  protein  scaffolds.  The 
process  works  by  using  a  detergent-like  chemical  to  remove  cells  from  a  native  artery,  thus 
leaving  behind  a  tubular  scaffold  composed  of  native  protein  structures.  Wc  successfully  created 
and  implemented  a  deccllularization  protocol  to  create  tubular  protein  scaffolds  from  porcine 
arteries,  as  illustrated  in  Figure  5. 


Figure  5:  Histology  performed  on  control,  native  porcine  arteries  (left  image)  and 
decellularized  porcine  arteries  (right  image)  revealed  that  0.075%  SDS  protocols  resulted 
in  a  tubular  protein  scaffold  devoid  of  cells. 


Although  deccllularization  results  were  successful,  and  subsequent  mechanical  assessment 
revealed  more  appropriate  scaffold  properties  as  compared  with  ePTFE,  attempted  scale-up  led 
to  a  major  challenge:  harvested  porcine  vessels  come  in  all  different  sizes,  and  thus  it  was  not 
feasible  lo  create  a  consistent  set  of  biologic  scaffolds  for  implementation  in  the  BVM. 

Although  deccllularization  work  will  continue  to  be  explored  in  our  laboratory  for  other  tissue 
engineering  applications,  it  was  determined  to  be  impractical  for  current  BVM  applications  and 
therefore  for  this  project.  Research  efforts  were  thus  focused  on  creating  synthetic  polymer 
scaffolds  with  improved  mechanical  properties. 

Developing  Synthetic  Vessel  Scaffolds 

Following  extensive  literature  review  regarding  feasible  fabrication  methods  for  creating 
polymer  tubes  in-house,  the  method  of  electrospinning  was  selected.  This  method  was  attractive 
due  to  the  potential  for  varying  and  controlling  fiber  diameter,  fiber  orientation,  polymer  type, 
and  therefore  mechanical  properties.  Through  a  separate  project,  an  electrospinning  apparatus 
was  built,  as  illustrated  in  Figure  6.  The  system  is  driven  by  a  high  voltage  power  supply  that 
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causes  a  polymer  solution  to  be  collected  around  a  rotating,  translating  mandrel,  which  leads  to 
creation  of  a  tubular  polymer  scaffold. 


Figure  6:  Electrospinning  apparatus  built  in-house  to  create  custom  polymer  scaffolds. 
Components  include  a  high  voltage  power  supply  (A),  a  rotating/translating  mandrel  (B) 
with  dual-speed  control  box  (C),  syringe  pump  for  polymer  solution  infusion  (D),  external 
power  supply  (E),  dual  switch  array  (F),  AC/DC  power  converter  (G)  and  chamber  (H). 

Funding  and  studies  supported  by  this  project  focused  on  two  different  polymers  for  use  in  the 
electrospinning  system.  Although  polyurethanes  had  been  proposed,  these  were  not  pursued  due 
to  cost  and  protocol  challenges.  However,  P(LLA-CL)  and  PLGA  were  both  identified, 
purchased,  and  utilized  for  electrospinning  experiments.  The  P(LLA-CL)  was  selected  for  its 
ease  of  use  and  was  used  to  perform  system  studies  on  variables  such  as  solution  concentration 
and  voltage.  In  addition,  following  protocol  establishment,  multiple  P(LLA-CL)  scaffolds  were 
produced,  as  shown  in  Figure  7,  and  assessed  based  on  fiber  diameter  and  mechanical  properties 
to  determine  the  consistency  and  reproducibility  of  the  electrospinning  process. 


Figure  7:  Electrospun  tubular  scaffold  on  a  glass  mandrel  (left)  and  SEM  image  of 
electrospun  scaffold  fibers  (right)  illustrating  the  micron-size,  customizable  fibers. 
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Following  the  establishment  of  our  in-house  electrospinning  fabrication  system  and  based 
on  results  from  P(LLA-CL)  supporting  the  scalability  and  consistency  of  the  electrospinning 
process,  PLGA  was  selected  as  a  more  appropriate  polymer  to  pursue  for  BVM  applications. 

This  selection  was  primarily  based  on  literature  supporting  HUVEC  compatibility  with  PLGA, 
as  well  as  adequate  degradation  rates  and  mechanical  properties  for  our  vessel  model.  PLGA 
protocols  were  successfully  established  and  PLGA  tubes  were  spun  and  evaluated  based  on  fiber 
diameter  and  mechanical  properties.  Results  from  tensile  testing  indicated  that  stress-strain 
results  and  the  calculated  Young’s  modulus  for  electrospun  PLGA  scaffolds  were  closer  to 
native  values  than  ePTFE  scaffolds.  Example  tensile  testing  results  from  a  polymer  spun 
according  to  our  optimized  protocol  are  provided  in  Figure  8. 
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Figure  8:  Tensile  testing  results  from  electrospun  PLGA  scaffolds  demonstrated  that 
mechanical  properties  were  more  similar  to  native  vessels  than  previous  ePTFE  scaffolds. 


Assessing  Potential  for  BVM  Cultivation  using  New  Polymeric  Scaffolds 

The  final  studies  in  Task  2  were  focused  on  assessing  the  implementation  of  our  new 
scaffolds  within  the  BVM  system.  As  described,  biologic  scaffolds  did  not  posses  adequate 
mechanical  properties  (collagen  tubes)  or  were  not  scalable  (decellularized  scaffolds),  and  thus 
cell  studies  were  not  performed.  However,  both  P(LLA-CL)  and  PLGA  polymers  were 
successfully  fabricated,  gas  sterilized,  and  incorporated  into  BVM  systems.  HUVECs  were 
sodded  onto  electrospun  scaffolds  and  cultivated  for  up  to  7  days.  Overall,  results  illustrated  that 
HUVEC  sodding  was  possible  and  that  HUVECs  adhered  to  both  types  of  polymer  scaffolds. 

Specifically  with  regard  to  the  P(LLA-CL)  scaffolds,  SEM  and  fluorescent  imaging 
results  revealed  that  although  cells  adhered,  the  lining  was  not  confluent.  This  was  attributed  to 
the  relatively  large  fiber  diameters,  which  may  have  been  suboptimal  for  cell  adhesion,  and  the 
porous  structure  that  may  have  allowed  cells  to  penetrate  through  the  scaffold  wall  and  out  of  the 
vessel  entirely.  In  addition,  P(LLA-CL)  vessels  were  not  cultivated  for  more  than  2  days  due  to 
the  degradation  characteristics  of  the  material.  However,  these  preliminary  cell  studies 
supported  the  capability  of  sterilizing  and  working  with  electrospun  materials  for  the  BVM 
scaffolds. 

Subsequent  HUVEC  studies  focused  on  the  PLGA  scaffolds,  and  again-  results  illustrated 
that  HUVECs  could  be  sodded  within  these  vessels  and  that  they  could  adhere  to  the  luminal 
surface.  Fluorescent  imaging  revealed  cells  present  within  the  BVM  at  all  time  points  assessed 
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(up  to  7  days).  An  example  fluorescent  image  illustrating  HUVEC  deposition  on  a  PLGA 
scaffold  is  provided  in  Figure  9. 


Fiture  9:  Fluorescent  image  illustrating  HUVECs  successfully  deposited  and  cultivated 
within  PLGA  scaffolds  after  6  days. 

Similar  images  were  obtained  at  all  other  time  points.  Although  implementation  and  cell 
sodding  was  a  success,  results  indicated  that  HUVECs  were  being  deposited,  or  migrating,  into 
the  vessel  wall,  and  thus  future  work  will  focus  on  maintaining  the  endothelial  cell  lining  as  a 
luminal  monolayer.  This  can  likely  be  accomplished  by  varying  pore  size  and  fiber  diameter. 


Outcomes  and  Significance 

Overall,  the  major  outcomes  of  this  project  included  the  establishment  of  new  protocols 
for  flow  and  scaffold  methods  in  tissue  engineered  blood  vessel  mimics,  results  supporting  the 
implementation  of  physiologic  flow  conditions  and  more  mechanically-appropriate  polymer 
scaffolds,  successful  training  and  involvement  of  numerous  engineering  students,  and 
dissemination  of  results  at  two  conferences.  A  summary  of  the  outcomes  based  on  each 
proposed  hypothesis  is  provided  below: 

HYPOTHESIS  1 :  Physiologic  flow  conditions  can  be  implemented  by  increasing  viscosity  and 
by  inducing  pulsatility  through  specific  pump  and  bioreactor  configurations.  Endothelial  cells 
within  the  vessel  mimics  will  withstand  these  conditions. 

OUTCOMES;  Media  viscosity  was  increased  by  adding  dextran  and  thus  wall  shear 
stress  was  successfully  adjusted  to  physiologic  levels.  Pump  configuration  was  altered 
through  the  addition  of  a  3-roller  pump  and  a  variety  of  tubing  clamps  and  valves,  and 
thus  pulsatile  flow  with  pressure  fluctuations  was  successfully  implemented.  Cell-sodded 
blood  vessel  mimics  were  able  to  withstand  these  new  flow  conditions. 

HYPOTHESIS  2:  A  compliant  scaffold  can  be  developed  that  will  support  formation  of  a  more 
physiologic  vessel  structure  as  compared  with  existing  vessel  mimics. 

OUTCOMES:  Collagen  scaffolds  and  decellularized  scaffolds  were  not  feasible  for 
implementation  within  the  BVM  system,  but  electrospinning  was  successfully 
implemented  for  creating  custom  polymer  scaffolds  with  more  native  mechanical 
properties.  These  scaffolds  supported  BVM  cultivation. 
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Key  outcomes  from  the  project  are  summarized  below: 

>  Protocols  established  and  implemented  for  creating  media  with  specified  viscosities 
through  the  addition  of  dextran. 

y  Protocols  established  and  implemented  for  inducing  pulsatile  flow  and  pressure 
fluctuations  within  the  BVM  bioreactor  system. 

>  Protocols  established  for  creation  of  collagen  and  decellularized  scaffolds.  (Although  this 
was  not  pursued  further  for  BVM  cultivation,  these  protocols  have  been  implemented  in 
Tissue  Engineering  and  Biomaterials  course  laboratories) 

>  Protoeols  established  and  implemented  for  electrospinning  P(LLA-CL)  and  PLGA, 
performing  mechanical  testing  on  scaffolds,  and  assessing  pore/fiber  structure  of  scaffolds 

>  Results  from  flow  studies  indicating  that  sodded  HUVECs  can  withstand  physiologic 
shear  stresses  and  pulsatile  flow  waveforms. 

>  Results  from  electrospinning  illustrating  that  scaffolds  can  be  custom-made  in-house  to 
have  appropriate  mechanical  properties  and  to  support  BVM  cultivation 

>  Involvement  and  training  of  7  engineering  students  at  the  undergraduate  and  MS  level  in 
various  aspects  of  the  project  (4  undergraduates,  3  MS  students) 

>  Experimental  work  contributing  towards  the  completion  of  3  Biomedical  Engineering  MS 
theses  and  4  undergraduate  projects 

>  Presentation  of  work  by  two  students  at  the  annual  Biolnterfacc  conference  (see  attached) 

o  Including  2"*^  place  award  for  Best  Student  Poster  for  Colby  James 

^  Presentation  of  work  by  P.I.  (Kristen  Cardinal)  at  annual  Tissue  Engineering  and 
Regenerative  Medicine  International  Society  (see  attached  abstract) 

>  Preliminary  work  and  data  supporting  National  Seienee  Foundation  CAREER  award 
application 

These  outeomes  are  signifieant  for  a  variety  of  reasons.  First,  our  results  contribute  to 
knowledge  within  the  tissue  engineering  field,  as  described  in  the  project  proposal.  Second,  the 
improved  BVM  system  has  even  greater  potential  to  impact  the  field  of  intravascular 
technologies  as  a  preelinical  testing  system.  Third,  and  speeifically  with  regard  to  the  Offiee  of 
Naval  Research,  we  have  made  great  strides  in  creating  a  model  that  could  be  used  to  develop 
enhanced  treatment  or  screening  technologies  for  injured  civilians  and  soldiers.  In  addition,  this 
projeet  strengthens  the  paradigm  of  using  tissue  engineering  eapabilities  as  in  vitro  model 
systems,  which  could  apply  to  other  DOD-sponsored  tissue  engineering  projects.  And  finally, 
the  work  performed  through  this  project  led  to  experience  and  training  of  engineering  students  at 
multiple  levels  of  their  education. 

Future  Work 

Future  work  related  to  this  project  could  involve  a  range  of  improvements  or  additional 
directions,  such  as: 

>  Combining  the  improved  physiologic  components  for  creation  of  an  “ideal”  BVM  (that 
includes  viscous  media  circulating  in  a  pulsatile  flow  loop  through  an  electrospun  scaffold.) 

>  Stent  or  device  evaluation  within  the  improved  BVM,  for  comparison  to  animal  or  clinical 
data  to  validate  the  model. 

>  Development  of  disease  or  injury-specific  BVM  systems  targeting  therapies  and  technologies 
that  are  difficult  to  evaluate  in  traditional  preelinical  models 
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Introduction 

In  recent  years  Civil  Engineers  are  faced  with  a  unique  challenge  of  protecting  public 
infrastructures  from  intentional  attacks.  Eight  key  infrastructures  that  arc  “lifelines”  to 
our  society  are  identified  by  the  President’s  Commission  on  Critical  Infrastructure 
Protection  (PPD  63,  1998).  One  of  these  key  infrastructures  is  water  supply  system  - 
damage,  disruption  or  inadequate  capacity  of  which  jeopardizes  our  economy  and  social 
well  being  significantly. 

The  water  infrastructure  system  in  USA  is  a  major  national  asset  valued  at  approximately 
S675  billion  (Grigg,  1999).  The  USEPA  (2003a)  has  reported  that  about  170,000  public 
water  systems  provide  water  for  more  than  250  million  Americans.  Water  distribution 
systems  are  vulnerable  to  intentional/  terrorist  attacks  because  they  arc  extensive,  easily 
accessible,  relatively  unprotected,  and  often  isolated  (USEPA  2002,  2003b,  Grayman, 
2002;  Mays,  2004). 

Intentional  attacks  on  water  distribution  systems  can  be  classified  as  (i)  physical,  (ii) 
cyber,  and  (iii)  chemical/biological.  Physical  attacks  aim  at  destroying  or  damaging  the 
water  distribution  networks  by  targeting  the  components  such  as  pipes,  pumping  stations, 
water  tanks  and  other  facilities.  Cyber  attacks  are  aimed  at  damaging  and  corrupting  the 
information  management  system  for  water  infrastructure  -  Supervisory  Control  and  Data 
Acquisition  (SCADA)  system,  while  the  chemical/biological  attacks  deal  with  releasing 
life-threatening  chemical  and  biological  agents  into  the  water  systems.  However,  physical 
attacks  are  far  more  likely  due  to  availability  of  explosive  materials,  and  the  lower 
expense  and  level  of  technical  expertise  required  (Bums  et  al.,  2002;  Murray  et  al.,  2004). 
Furthermore,  human  errors  and  natural  disasters  can  lead  to  physical  damage/  destmetion 
of  water  systems  as  well.  The  current  research  focuses  on  methods  to  make  the  water 
distribution  systems  more  resilient  to  physical  destmetions. 

Current  State  of  Knowledge 

As  for  any  other  critical  infrastructures,  in  recent  years  the  government  has  promoted  risk 
and  vulnerability  assessment,  emergency  response,  training  of  water  facility  personnel, 
and  research  towards  detecting  and  mitigating  attacks.  To  date  most  of  the  research  on 
vulnerability  assessment  and  mitigation  of  water  systems  are  qualitative  or  based  on 
subjective  judgments  from  security  experts.  All  water  systems  that  service  over  3,300 
people  are  mandated  by  the  Section  1433  of  the  Public  Health  Security  and  Bioterrorism 
Preparedness  and  Response  Act  of  2002  to  perform  vulnerability  assessment.  Widely 
used  methods  in  industry  -  2001  AWWA  (Ml 9)  Vulnerability  Assessment  (4th  Edition), 
the  Vulnerability  Assessment  Tool  (VSAT™  -WATER)  and  the  Risk  Assessment 
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Methodologies  for  Water  Utilities  (RAM-W^"^),  are  all  based  on  subjective  scoring 
systems  from  surveys  of  water  personnel. 

In  addition  majority  of  the  research  are  dedicated  to  chemical/biological  and  cyber 
attacks.  A  more  quantitative  approach  for  probabilistic  risk  assessment  to  the  SCADA 
system  using  expenditure,  certainty,  and  flow  reduction  as  performance  measures  as 
presented  by  Ezell  (1998).  This  method  was  applied  to  chemical  attacks  on  water  tanks  in 
small  water  systems  (Ezell,  2000a,  b)  as  well.  Chemical  and  biological  attack  scenarios 
were  addressed  by  a  significant  number  of  researchers,  particularly  in  development  of 
effective  layouts  and  design  of  contaminant  monitoring  stations  for  early  detection  and 
identification  (Lee  and  Deininger,  1992;  Kumar  et  al,  1997;  Harmant  et  al.,  1999;  Woo  et 
al.,  2001;  Al-Zahrani  and  Moied,  2001;  Van  Bloemen  Waanders  et  al.,  2003;  Ostfeld  and 
Salomons,  2004;  Berry  et  al.,  2004;  Laird  et  al,  2004).  Bahadur  et  al  (2001,  2003) 
developed  PipelineNet  Model  through  the  integration  of  Arcview  and  EPANET  that 
stimulates  contaminant  transport  in  water  distribution  systems. 

Although  there  exist  potential  risk  assessment  and  mitigation  strategies  in  other  fields  to 
be  applied  to  water  infrastructure,  the  nonlinear  nature  of  hydraulic  systems  prohibit 
applications.  In  telecommunication  numbers  of  approaches  are  available  that  focus  on 
network  connectivity  and  the  transition  capacity  of  the  nodes/  edges  while  some  subset  of 
the  nodes/  edges  fail  (Monma  and  Shallcross,  1989;  Sakauchi  et  al,  1990;  Chujo  et  al, 
1991;  Grdtschel  et  al,  1992,  1995;  Veerasamy  et  al,  1995,  1999;  Balakrishnan  et  al, 
2001,  2002).  Network  interdiction  is  another  closely  related  area  that  addresses  the  how 
to  best  attack  a  network  to  decrease  some  measure  of  its  flow  and  uses  more  quantitative 
approaches  (Wollmer,  1964;  McMasters  and  Mustin,  1970;  Ghare  et  al,  1971;  Wood, 
1993;  Philips,  1993).  As  mentioned  fundamental  system  differences  prohibit  adaptations 
of  these  methods  to  water  supply  systems. 

Optimization  methods,  such  as  dynamic  programming  (DP),  branch-and-bound  (B&B) 
and  genetic  algorithms  (GAs),  are  widely  used  in  the  water  industry  for  determining  the 
optimal  layout  and  component  size  distribution  associated  with  a  desired  cost  and  level  of 
reliability.  Recently  these  algorithms  are  being  adopted  to  address  various  aspects  or 
consequences  of  physical  attacks  on  water  systems.  Jeong  et  al.  (2006)  applied  B&B  and 
GAs  along  with  a  hydraulic  solver  to  identify  a  feasible  customer  demand  pattern  that 
minimizes  the  consequences  of  water  shortage  in  the  residual  water  systems.  Jeong  and 
Abraham  (2006)  developed  an  operational  response  model  using  multi-objective  GA  to 
find  solutions  that  indicate  the  minimum  consequences  of  an  intentional  attack  on  water 
infrastructure.  Quio  et  al.  (2007)  presented  a  method  that  integrates  max-min  linear 
programming,  hydraulic  simulation  and  GAs  for  allocation  of  security  budget  to  a  water 
supply  system  to  maximize  the  system’s  resilience  to  physical  attacks. 

Scope  of  the  Work 

Water  supply  systems  are  designed  not  only  to  meet  the  community  demands  but  also  to 
supply  adequate  water  for  fire  fighting  during  natural  or  man-made  disasters.  Typically 
water  mains  are  positioned  in  a  grid  pattern  so  that  the  failure  of  a  single  section  isolates 
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the  damaged  section  and  the  rest  of  the  system  ean  carry  water  to  provide  adequate  water 
for  fire  fighting.  Leaks  in  the  pipes,  wear  and  tear  of  old  pipes,  or  terrorist  attacks  could 
cause  failures  of  segments  of  water  mains.  In  case  of  a  single  segment  failure  the  residual 
system  is  designed  to  provide  adequate  flows  and  pressures  at  different  fire  hydrants.  But 
if  multiple  segments  fail,  which  is  most  probable  in  the  scenarios  of  terrorist  attacks,  the 
water  supply  system  might  not  be  able  to  provide  the  security  required  by  the  community. 

Literature  review  shows  that  reliability  of  water  infrastructure  systems  has  not  been 
assessed  in  terms  of  inadequacy  of  fire  flows  and  subsequent  consequences  or  propagated 
damages  as  a  result  of  insufficient  fire  fighting  capabilities.  The  current  research 
developed  a  quantitative  method  for  vulnerability  assessment  of  water  systems  due  to 
insufficient  fire  flows  using  GIS  tools,  hydraulic  simulation  model  EPANET  and  an 
optimization  model.  The  optimization  model  was  developed  using  dynamic  programming 
techniques  to  indicate  which  pipes/  components  of  the  network,  if  damaged  and/or 
removed,  would  cause  maximum  fire  damage  to  the  community. 

Methodology 

The  present  study  has  two  distinct  components:  (i)  integration  of  GIS  tools  with  hydraulic 
model  EPANET,  and  (ii)  development  of  optimization  model. 

Integration  of  GIS  tools  with  EPANET 

EPANET  is  widely  used  in  practice  for  design,  analysis,  operation  and  maintenance  of 
the  water  distribution  systems.  Hydraulic  models  such  as  EPANET  (Rossman,  2000) 
offer  the  capability  of  determining  the  flow  rate  in  each  pipe  segment,  pressure  at  each 
node  or  junction  as  well  as  concentration  of  chemicals  throughout  the  system  during 
desired  simulation  period.  The  latest  version  EPANET  2.0  is  freely  available  at  EPA 
official  website  (http://www.cpa.gov/ORD/NRMRL/wswrd/epanct.html). 

Like  most  hydraulic  models  EPANET,  to  set  up  the  water  distribution  system  topology, 
requires  extensive  spatial  and  hydraulic  infrastructure  data  such  as  topography, 
road/strect  layouts,  site  development,  land  use  etc.  Construction  of  the  schematic  of  a 
pipe  network  manually  is  extremely  resource  and  time  intensive.  GIS  can  greatly  assist  in 
building  the  hydraulic  models  data  file  due  to  its  unique  ability  to  capture  and  store 
spatial  data,  to  build  relational  database  and  to  display  data  graphically.  Furthermore  a 
properly  installed  water  distribution  system  with  adequate  fire  flow  typically  lasts  for  70 
to  100  years.  Since  the  design,  construction,  and  maintenance  of  water  infrastructure  is  a 
long  term  investment  GIS  can  be  used  as  a  long  term  planning  and  management  tool  to 
update  easily  as  development  or  modification  occurs. 

EPANET  hydraulic  model  data  file  was  created  using  AreView.  The  topographic  and 
land  use  data  was  downloaded  from  USGS  official  website.  Components  of  the  water 
system  to  be  analyzed  were  removed  to  create  possible  physical  attack  scenarios.  Then 
EPANET  was  applied  to  the  remainder  of  the  water  network  after  the  attack  to  determine 
the  nodal  pressures  and  flows  through  the  residual  water  distribution  system.  Usually  the 
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required  pressure  for  fire  fighting  is  20  psi,  and  the  required  flow  is  1500  gpm  for  single 
family  residential  area  and  2500  gpm  for  multi-family  and  commercial  area.  From  the 
hydraulic  simulation  results  areas  where  the  pressure  varies  between  0  and  20  psi  was 
identified  to  indicate  which  segments  of  a  system  are  most  vulnerable  to  fire  damage 
subsequent  to  terrorist  attacks.  Various  attack  scenarios  are  considered  and  those  that  do 
not  create  reduced  fire  fighting  capabilities  were  not  considered  for  this  study. 

Development  of  Optimization  Model 

In  this  study,  nonlinear  hydraulic  constraints  are  computed  using  EPANET.  During  the 
optimization  trials  hydraulic  constraints  are  used  to  evaluate  the  maximum  damage  in 
terms  of  the  indicators  used.  Three  indices  were  used  in  this  study  to  measure  the 
damages  due  to  a  physical  attack  on  water  system:  (i)  economic  loss,  (ii)  the  number  of 
affected  people,  and  (iii)  the  degree  of  disruption  of  critical  infrastructure  facilities. 

Economic  loss  was  calculated  for  reduced  production  activities  due  to  disruption  of  water 
supply  as  well  as  for  insufficient  fire  fighting  abilities.  Loss  due  to  water  supply 
disruption  was  calculated  using  resiliency  factor  of  the  industry/  sector  affected.  The 
resiliency  factor  presents  the  percentage  of  the  continuation  of  the  sales  or  production  of 
a  specific  industry/  sector  in  case  of  a  total  water  outage.  Resiliency  factors  for  various 
sectors  are  available  in  post-earthquake  research  studies  (ATC,  1991;  Tierney  and  Nigg, 
1995;  Cheng  et  al.,  2002). 

Additional  damage  due  to  insufficient  fire  fighting  was  addressed  by  modifying  the 
available  resiliency  factors.  As  an  indicator  of  the  fire  damage  a  linear  relationship  was 
introduced  in  terms  of  the  required  pressure.  For  example  if  the  available  pressure  in  the 
damaged  network  provides  half  of  the  required  pressure  at  the  fire  fighting  location  then 
half  of  the  area  that  the  fire  hydrant  is  supposed  to  service  will  be  assumed  damaged.  The 
resiliency  factor  for  any  industry  or  sector  in  that  area  was  reduced  by  50%  to  take 
account  of  the  fire  damage. 

The  number  of  people  affected  by  water  outage  can  be  determined  by  the  number  of 
residents  at  each  node/  junction  that  has  disrupted  water  service  after  the  attack.  In  the 
third  index,  energy  supply  facilities,  transportation  hubs,  banks  and  other  financial 
services,  telecommunication  centers,  emergency  services  (fire  stations,  hospitals  etc.), 
government  services  and  schools  are  considered  major  critical  infrastructure  facilities. 
Again  for  the  critical  facilities  degree  of  disruption  represent  both  the  effects  of  water 
shortage  or  outage  and  the  fire  damage.  For  example,  a  critical  infrastructure  might  have 
access  to  water  but  could  be  damaged  severely  due  to  fire  to  function  properly. 
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Damage  Function  for  a  particular  attack  scenario  /  was  represented  by: 


0/=I 


^avail 

P 

^req  J 


+  TT  +  ^cril 

N 


Fres  =  Resiliency  Factor 

P avail  -  Pressure  available  for  fire  fighting  in  the  damaged  network 
Preq  -  Prcssurc  required  for  fire  fighting  (20  psi  was  used  as  the  standard) 

P  =  Population  affected  by  water  outage  and/  or  fire  damage 
N  =  Constant  depending  on  the  population  served  by  the  water  system  damaged 
N  =  10,000  for  small  cities 

=  100,000  for  moderately  big  cities 
=  1,000,000  for  big  cities 

A<t//  =  Number  of  critical  infrastructures  affected  by  water  shortage  or  outage  and  the  fire 
damage 


The  damage  function  represents  the  total  damage  cased  due  to  insufficient  fire  flows  after 
intentional  physical  attacks.  Different  attack  scenarios  that  might  cause  insufficient  fire 
flows  were  assessed  for  damage  caused  by  fire  and  water  shortage  or  outage.  The  attack 
scenario  with  the  maximum  damage  was  identified  for  a  particular  water  distribution 
network  using  an  optimization  model.  Dynamic  programming  techniques  was  used  to 
develop  the  vulnerability  assessment  model  for  water  systems  as  a  result  of  diminished 
fire  fighting  capabilities.  The  DP  model  was  applied  to  various  hypothetical  water 
networks  available  in  literature. 

The  steps  are  shown  in  the  flowchart  in  Figure  1  in  next  page. 
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Figure  1. 
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Figure  2. 

Figure  2  shows  one  of  the  hypothetical  water  distribution  systems  used  in  the  current 
study.  The  red  nodes  indicate  junctions  with  pressures  less  than  20  psi  and  thus  causes 
reduced  fire  fighting  capability.  The  maximum  damage  scenario  was  identified  to  be  the 
destruction  or  isolation  of  the  pipes  P-71  and  P-72  that  causes  lower  left  part  of  the  water 
system  vulnerable  to  fire  damage  as  well  as  water  shortage. 

Accomplishments 

Two  undergraduate  students  were  employed  in  the  current  study.  A  conference 
proceeding  was  published  at  EWRI-AIT  Conference  on  "An  International  Perspective  on 
Environmental  and  Water  Resources",  January  5-7,  2009,  Pathumthani,  Thailand  on 
“Vulnerability  Assessment  of  Water  Distribution  Networks  due  to  Insufficient  Fire 
Flows”  by  Shikha  Rahman.  The  abstract  is  given  as  below; 

In  recent  years  Civil  Engineers  are  challenged  to  develop  solutions  to  protect  public 
infrastructures  from  intentional  attacks.  Water  distribution  system,  valued  approximately 
$675  billion,  is  identified  as  one  of  the  eight  key  infrastructures  by  the  President’s 
Commission  on  Critical  Infrastructure  Protection  (PPD  63,  1998).  Physical  attacks  are 
far  more  likely  than  cyber  and  chemical/  biological  attacks  due  to  availability  of 
explosive  materials,  and  the  lower  expense  and  level  of  technical  expertise  required. 
Furthermore,  human  errors  and  natural  disasters  can  lead  to  physical  damage/ 
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destruction  of  water  systems  as  well  Current  study  focuses  on  methods  to  make  the  water 
distribution  systems  more  resilient  to  physical  destructions.  Water  supply  systems  are 
designed  not  only  to  meet  the  community  demands  but  also  to  supply  adequate  water  for 
fire  fighting  during  natural  or  man-made  disasters.  Literature  review  shows  that 
reliability  of  water  infrastructure  systems  has  not  been  assessed  in  terms  of  inadequacy 
of  fire  flows  and  subsequent  consequences  or  propagated  damages.  The  objective  of  the 
current  research  is  to  present  a  quantitative  method  for  vulnerability  assessment  of  water 
systems  due  to  insufficient  fire  flows  using  GIS  tools,  hydraulic  simulation  model 
EPANET  and  an  optimization  model.  The  optimization  model  was  developed  using 
dynamic  programming  (DP)  techniques.  Developed  DP  model  was  applied  to  various 
attack  scenarios  for  a  particular  water  system  to  identify  which  one  causes  the  maximum 
damage.  The  study  is  funded  under  ONR-C3RP  grant  N00014-07-1-1 152. 
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Project  title:  A  portable  new  chemical/biological  sensor 


Project  aim;  The  aim  of  this  project  is  a  new  theoretical  design  for  a  liquid  crystal 
based  sensor  that  could  selectively  detect  certain  chemical  or  biological  contaminants. 
Such  a  sensor  would  be  highly  portable  making  it  advantageous  over  methods  that 
require  laboratory-based  instrumentation.  It  would  be  particularly  suitable  for 
military/counterterrorist  use  as  a  means  to  detect  biological  or  chemical  weapons  in 
the  field. 

Summary 

Basic  Principle 

The  main  premise  behind  the  operation  of  this  sensor  is  that  liquid  crystalline  matter 
can  be  made  chiral  (or  more  chiral)  when  exposed  to  certain  foreign  (e.g.  airborne 
biomolecular)  compounds.  This  could  happen  in  a  couple  of  different  ways.  One 
possibility  would  involve  chiral  compounds  diffusing  into  the  bulk  of  the  nonchiral 
liquid  crystal.  The  presence  of  this  chiral  dopant  would  then  induce  chirality  in  the 
liquid  crystal.  A  second  possibility  would  involve  a  foreign  compound  (chiral  or 
nonchiral)  binding  with  the  constituent  molecules  of  the  liquid  crystal  and  producing  a 
new  chiral  molecule.  One  could  also  have  a  combination  of  the  two  effects  whereby  a 
chiral  compound  both  diffuses  into  binds  with  the  liquid  crystal  molecules. 

In  either  of  these  cases  the  degree  of  this  chirality  would  be  proportional  to  the 
density  of  chiral  dopant,  which  would  decrease  with  distance  as  one  moved  from  the 
surface  into  the  bulk  of  the  liquid  crystal.  Thus,  one  would  a  have  a  gradient  in  the 
induced  chirality  of  the  liquid  crystal,  with  the  chirality  being  a  maximum  at  the 
surface  of  the  liquid  crystal.  This  would  differ  from  a  traditional  cholesteric  liquid 
crystal  phase  in  which  the  chirality  is  homogenous,  i.e.  uniformly  distributed. 

Results 


Analysis  of  the  effect  of  chiral  dopant  on  molecular  configuration 

The  project  has  to  date  been  very  successful.  To  analyze  the  configuration  of  the 
liquid  crystal  with  induced  chirality,  the  PI  and  his  undergraduate  student  assistant, 
Paul  Carlson,  have  used  an  established  method,  involving  the  Franck  elastic  energy 
[1,2].  This  method  was  used  to  determine  the  average  molecular  configuration  (and 
hence,  optical  axis)  of  both  nematic  and  cholesteric  liquid  crystals  that  have  been 
contaminated  with  chiral  dopant.  The  Franck  elastic  energy  combines  the  different 
types  of  elastic  energies  associated  with  the  fundamental  distortions  of  the  liquid 
crystal.  The  preferred  molecular  arrangement  is  the  one  that  minimizes  this  energy.  In 
the  case  of  traditional  cholesterics,  i.e.  with  homogenous  chirality,  this  minimization 
yields  a  helical  configuration  with  a  pitch  length  that  is  the  same  throughout  the 
sample. 

For  the  liquid  crystal  sensor  we  have  proposed,  the  analysis  involves  a  gradient  in  the 
chirality  as  one  moves  away  from  the  surface  where  the  chiral  doping  is  larger.  As  a 
first  step  in  the  development  of  our  analytical  technique  we  considered  two  artificial 


spatial  distributions  of  chirality.  By  “artificial  spatial  distributions”  of  chirality  we 
mean  distributions  that  would  not  necessarily  result  from  real  diffusion  of  chiral 
dopant  into  the  liquid  crystal.  The  reason  for  doing  so  was  that  we  had  a  good  idea  of 
what  type  of  average  molecular  configuration  to  expect  as  a  result  of  such  simpler 
distributions.  In  particular  we  considered  one  chiral  dopant  density  that  decayed 
linearly  and  another  that  decayed  exponentially  with  distance  away  from  the  liquid 
crystal-dopant  interface.  The  use  of  such  “simple”  distributions  thus  allowed  us  to 
ensure  that  our  non-trivial  analytical  technique  was  giving  sensible  results.  Indeed,  we 
found,  as  one  would  intuitively  expect,  that  the  spatially  inhomogeneous  chiral  dopant 
results  in  a  cholesteric  in  which  the  pitch,  rather  than  being  spatially  uniform,  gets 
longer  as  one  moves  away  from  the  surface. 

Our  next  step  was  to  use  our  technique  to  analyze  a  more  realistic  spatial  distribution 
of  chiral  dopant,  namely  one  resulting  from  its  diffusion  into  the  liquid  crystal  host. 

To  obtain  this  more  realistic  spatial  distribution  we  used  the  diffusion  equation.  An 
important  consequence  of  this  approach  is  that  the  spatial  distribution  will  now 
depend  on  time.  This  is  because  as  time  progresses,  more  and  more  chiral  dopant  will 
diffuse  further  and  further  into  the  liquid  crystal  host.  Using  Matlab,  we  were  able  to 
track  the  time-evolution  of  the  molecular  configuration  of  the  liquid  crystal.  We  found 
that  the  diffusion  of  the  chiral  dopant  results  in  a  cholesteric  in  which,  at  a  given 
instant  in  time,  the  pitch  gets  longer  as  one  moves  away  from  the  surface.  As  time 
progresses,  the  average  pitch  length  shortens  (i.e.  the  helix  tightens)  due  to  more 
dopant  diffusing  further  into  the  liquid  crystal. 

Analysis  of  the  reflection  of  light  from  the  liquid  crystal  with  induced  chirality 

Having  developed  our  method  for  calculating  the  molecular  arrangement  of  the  liquid 
crystal  with  induced  chirality,  we  have  now  moved  to  analyze  how  the  induced 
chirality  affects  the  reflection  of  light.  As  with  determining  the  molecular 
arrangement  of  the  liquid  crystal,  there  is  an  established  method  for  doing  this  [1,2]. 
This  method  involves  constructing  the  dielectric  tensor  corresponding  to  the 
molecular  arrangement.  One  can  then  use  this  dielectric  tensor  to  determine  the  effect 
of  the  liquid  crystal  on  the  polarization  of  the  propagating  light.  The  dielectric  tensor 
can  also  be  used  to  determine  how  induced  pitch  length  influences  the  selective 
reflection  of  certain  wavelengths.  This  will  be  important  in  relating  the  color  of 
reflected  light  to  the  amount  of  chiral  dopant,  and  thus  the  amount  of  foreign 
compound  that  is  present. 

We  have  adapted  the  basic  technique  to  analyze  light  propagation  in  a  liquid  crystal 
with  nontrivial  molecular  arrangement,  i.e.  one  due  to  the  diffusion  of  chiral  dopant. 

A  particularly  nice  result  of  our  being  able  to  track  the  time  evolution  of  the 
molecular  configuration  is  that  we  will  also  be  able  to  track  the  time  evolution  of  the 
dielectric  tensor.  This  in  turns  allows  us  to  track  how  the  light  propagation  is  being 
affected  by  the  diffusion  of  chiral  dopant  into  the  liquid  crystal. 


Remaining  tasks 


There  still  remains  some  work  to  complete  the  analysis  of  the  interaction  of  light  with 
the  chirally  doped  liquid  crystal.  In  particular  we  will  be  interested  in  understanding 
the  selective  reflection  of  certain  wavelengths. 

Once  we  have  performed  the  above  analysis  of  the  molecular  configuration  and  the 
effect  of  the  induced  chirality  on  the  propagation  of  light  through  the  liquid  crystal, 
we  will  determine  the  optimal  design  for  the  sensor.  While  the  details  of  the  design 
will  depend  on  the  specific  outcomes  of  the  above  analysis,  this  will  basically  involve 
determining  the  optimum  boundary  conditions  and  arrangement  of  optics  to  detect  a 
change  in  how  the  light  is  reflected  due  to  chirality  being  induced  in  the  liquid  crystal. 
We  would  then  establish  a  diagnostic  to  relate  this  change  in  the  reflected  light  to  the 
concentration  of  foreign  compound  that  is  present  in  the  liquid  crystal. 

New  ideas  and  possibilities 

While  selective  reflection  of  certain  wavelengths  of  light  is  one  possible  way  to  probe 
the  chiral  doping  of  a  liquid  crystal,  we  have,  during  the  course  of  our  analysis,  begun 
considering  two  other  possible  probes. 

One  would  be  to  examine  the  effect  of  the  chiral  dopant  on  the  critical  field  that  is 
required  to  unwind  the  twisted  molecular  configuration  in  the  cholesteric  phase.  A 
general  feature  of  cholesterics  is  that  an  electric  or  magnetic  field,  applied  in  the 
appropriate  direction,  tends  to  unwind  the  cholesteric  twist.  Above  a  finite,  critical 
field  the  twist  is  completely  unwound  and  the  optical  properties  are  much  like  a  field- 
aligned  nematic  phase.  The  critical  field  depends  on  the  degree  of  chirality  in  the 
system.  We  propose  to  analyze  the  effects  of  an  applied  field  on  our  system,  one  with 
a  spatially  varying  degree  of  chirality.  We  anticipate  that  there  should  still  be  a  critical 
unwinding  field  and  that  it  will  depend  in  some  non-trivial  way  on  the  amount  of 
additional  chirality  which  is  present,  due  to  some  chiral  contaminant. 

Lone-term  vision 

It  now  seems  likely  that  our  preliminary  analysis,  once  completed,  will  indicate  that 
this  proposed  sensor  design  would  allow  for  the  detection  of  induced  chirality.  The 
next  (highly  non-trivial)  stage  would  be  to  then  find/synthesize  a  liquid  crystal  that 
would  become  chiral  when  it  reacted  with  a  chemical  or  biological  compound  whose 
detection  is  desired.  An  important  consideration  would  be  selectivity,  i.e.  the  ability  to 
selectively  detect  a  particular  agent  of  interest.  When  an  appropriate  material  has  been 
found,  we  hope  that,  having  obtained  external  funding,  the  sensor  could  be 
constructed  at  Cal  Poly  with  the  involvement  of  Dr  Jonathan  Femsler,  an  experienced 
liquid  crystal  experimentalist. 

Immediate  plans  for  continuation  of  the  project 

In  addition  to  the  obvious  need  to  complete  the  analysis  of  the  interaction  of  light  with 
the  chirally  doped  liquid  crystal,  we  would  also  like  to  do  further  work  on  the  other 
two  possible  chiral  probes  discussed  above  in  the  section  New  Ideas  and  possibilities. 
We  thus  plan  to  seek  a  renewal  of  funding  for  further  work  on  the  project. 


[1]  For  a  more  advanced  overview  of  liquid  crystals  see  P.G.  de  Gennes,  J.  Frost,  The 
Physics  of  Liquid  Crystals  (Oxford  University  Press,  1993) 

[2]  P.M.  Chaikin,  T.C.  Lubensky  and  Principles  of  Condensed  Matter  Physics, 
(Cambridge  University  Press,  1995). 
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Solar  Transportation:  Sunlight  to  Electricity  to  Motion 

Summary  of  2008  work 

Peter  V.  Schwartz,  Cal  Poly  Physics  Department 


1  Abstract 

We  have  studied  both  solar  concentrators  as  well  as  electrical  transportation.  We  have  simulated 
sunlight  falling  on  a  stationary  solar  concentrator,  which  focuses  the  concentrated  sunlight  onto  a 
stationary  target  by  means  of  a  mobile  secondary  mirror.  By  writing  subroutines,  wc  were  able  to 
optimize  both  the  shape  of  the  secondary  mirror  as  well  as  the  trajectory  it  must  follow  with  the 
changing  incident  angle  of  the  sunlight.  This  work  was  published  in  the  proceedings  of  the  2008 
SPIE  conference  in  San  Diego.  Publication  in  Journal  of  Solar  Energy  is  pending.  Lastly,  wc 
compared  gasoline  cars  versus  electric  cars  with  respect  to  life  cycle  costs  and  with  respect  to 
effective  energy  density  of  the  drive  trains,  resulting  in  two  publications  in  Journal  of  Energy  Policy. 


MODELING  OF  SOLAR  CONCENTRATOR 

INTRODUCTION 

Large  solar  concentration  devices  have  traditionally  consisted  of  a  parabolic  primary  mirror,  which 
focuses  light  onto  a  target,  such  as  a  heat  collecting  element  (HCE)  or  photovoltaic  cell  (PV).  In 
order  to  keep  the  target  at  the  focus  of  the  primary  mirror,  the  entire  mirror  must  rotate  about  either 
one  axis  (for  trough  systems),  or  two  axes  (for  dish  systems). 

U.S.  Patent  #2,1 82,222  (December  5,  1939)  provides  for  a  parabolic  trough  solar  concentrator  that 
tracks  the  sun  through  its  apparent  motion  across  the  sky  (Fig.  la).  The  patent  provides  for  a  motor 
to  rotate  the  reflecting  trough  in  order  to  track  the  apparent  motion  of  the  sun  perpendicular  to  the 
trough  axis.  Today,  modem  central  station  Solar  Thermal  Electric  (STE)  facilities  still  use  a  very 
similar  technology,  such  as  the  “EuroTrough”  (Fig.  lb),'  where  both  the  parabolic  trough  and  the 
HCE  rotate  about  a  common  pivot. 


Fig.  1  (a)  An  original  patent  figure  of  a  tracking  parabolic  trough,  (b)  Modem  “EuroTrough”  (see 
text) 
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Figure  lb  illustrates  why  a  considerable  amount  of  the  capital  cost  and  complication  of  construction 
of  a  parabolic  trough  system  is  due  to  the  need  to  rotate  the  assembly.  The  mirrors  and  HCE  are 
often  made  of  glass  and  must  be  delicately  held  in  place  with  a  high  degree  of  angular  tolerance, 
while  hot  (and  possibly  pressurized)  fluids  circulate  in  the  HCE  and  through  piping  that  must  pivot 
as  the  drive  mechanism  tracks  the  sun.  A  recent  NREL  (National  Renewable  Energy  Laboratory, 
Golden,  Colorado)  study^  indicates  that  60%  of  the  cost  of  an  STE  facility  is  the  solar  field. 
Additionally,  half  the  cost  of  the  solar  field  may  be  due  to  the  need  to  track  the  large  parabolic 
mirrors. Lastly,  the  need  to  carefully  construct  the  rotating  troughs  to  support  heavy  rigid  mirrors 
complicates  construction  and  increases  construction  time. 

More  recent  innovations  reduce  the  extent  of  hardware  necessary  to  track  the  sun.  These  geometries 
include  an  embodiment  with  a  mobile  target,  which  can  move  to  the  location  of  the  focused  light.^ 
Additionally,  a  tunable  Fresnel  mirror  assembly  is  presently  being  exploited  by  Ausra^  for  large 
scale,  central  station  deployment  whereby  the  Fresnel  mirror  sections  on  the  ground  rotate  to  reflect 
sunlight  onto  a  stationary  overhead  target.  Lastly,  Solargenix’  manufactures  a  system  called  Power 
Roof  that  involves  a  unique  trough  concentrator  of  circular  cross  section,  allowing  a  compound 
parabolic  collector  (CPC)  to  follow  the  reflected  concentrated  light.  While  these  innovations  lower 
the  size  of  the  components  that  track,  there  still  exists  significant  complexity  and  cost  associated 
with  solar  tracking. 

The  design  we  propose  here  is  similar  to  that  of  a  Gregorian  telescope  (Fig.  2).  In  such  an  optical 
system,  a  large  primary  concave  mirror  directs  light  onto  a  smaller  secondary  concave  mirror  located 
above  the  primary  and  centered  about  the  optical  axis  between  the  two  mirrors.  The  secondary 
mirror  serves  to  correct  for  spherical  aberration  and  redirect  the  light  back  toward  the  primary 
mirror.  Such  a  system  has  been  studied  before  as  a  way  to  achieve  high  solar  flux  concentrations.^ 
However,  in  this  previous  work  the  spatial  relationship  between  the  primary  and  secondary  mirrors 
remains  fixed  and  the  entire  system  must  be  oriented  with  respect  to  the  incident  sunlight  to  maintain 
focus. 


Fig.  2  Diagram  of  a  Gregorian  telescope. 

Our  proposed  concentrator  design  promises  to  simplify  construction  and  reduce  costs  by  allowing 
both  the  primary  mirror  and  target  to  be  stationary.  Focusing  is  achieved  through  the  movement  of 
the  smaller,  secondary  mirror  (Fig.  3).  While  the  movement  of  the  secondary  mirror  presents 
significant  challenges,  this  system  has  the  potential  to  be  produced  on  site  quickly  and  inexpensively 
by  embedding  the  primary  mirror  and  target  directly  in  the  earth.  In  this  paper,  we  explore  the 
performance  of  a  trough  concentrator  system.  However,  the  idea  can  equally  be  applied  to  dish 
geometry. 
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Fig.  3  Incident  sunlight  is  reflected  from  a  stationary  primary  mirror  and  focused  onto  a 
stationary  target  by  means  of  a  smaller,  mobile  secondary  mirror.  If  the  surface  is  optimized  for 
equinox,  summer  and  winter  light  is  still  focused  well  onto  the  same  target. 


METHODOLOGY 

Modeling  of  the  shape  and  placement  of  reflecting  surfaces  was  made  possible  with  commercial  ray¬ 
tracing  software  {LightTools  6.1.0  by  Optical  Research  Associates).  We  used  the  Solar  Tracking 
Utility  included  in  LightTools  to  provide  realistic  simulations  of  collector  performance  at  San  Luis 
Obispo,  CA  (Latitude  35.27°,  Longitude  -120.66°).  Since  the  performance  of  the  concentrator  is 
wholly  dependent  on  the  orientation  between  the  sun  and  the  collector,  we  evaluate  collector 
performance  oriented  both  normal  to  the  surface  and  tilted  at  latitude.  Performance  at  other 
locations  can  easily  be  inferred  from  the  simulation  data  gathered  for  this  one  location.  We  ran 
simulations  for  three  dates  that  give  the  operating  extremes  of  collector  performance:  Vernal 
Equinox,  Summer  Solstice  and  Winter  Solstice.  Modeling  was  purely  geometric:  mirrors  were 
assigned  a  reflectivity  of  100%  and  the  HCE,  a  reflectivity  of  0%.  We  used  a  constant  solar 
irradianee  value  of  1000  W/m^.  We  ran  simulations  of  two  different  HCE  types  with  the  same  size 
aperture:  a  flat  plate  and  a  cylindrical  absorber  using  a  tertiary  reflector  (an  involute  CPC^).  Results 
arc  reported  in  terms  of  efficiency  as  well  as  concentration. 

The  primary  mirror  has  a  circular  cross  section,  as  opposed  to  a  parabolic  cross  section.  Wc  chose  a 
circular  mirror  because  the  coma  (concentrated  area  of  reflected  light)  has  the  same  form  for  all 
incident  angles.  Therefore,  a  single  secondary  mirror  might  be  able  to  focus  the  reflected  light  onto 
the  target  for  all  ineident  angles  of  the  original  light.  The  eoma  follows  a  path  that  is  roughly 
concentric  to,  and  located  at  half  the  radius  of  the  primary  mirror  and  so  we  used  this  path  as  a 
starting  point.  Subsequent  optimization  resulted  in  only  minor  deviations  from  a  circular  path  for  the 
sceondary  mirror. 

Wc  optimized  the  shape  of  the  secondary  mirror  for  every  angle  of  solar  incidence  from  0°  -  40°;  we 
ehose  an  upper  limit  of  40°  because  it  allowed  our  system  to  track  the  sun  for  most  of  the  usable 
daylight  hours  over  the  course  of  an  entire  year.  From  the  resulting  secondary  mirror  shapes,  wc 
selected  the  surface  that  provided  the  highest  average  solar  flux.  Using  this  shape  as  the  secondary 
mirror,  we  wrote  computer  code  utilizing  an  Application  Program  Interface  (API)  within  LightTools 
6. 1.0  to  further  define  the  path  of  the  secondary  mirror  as  that  which  maximized  solar  flux  on  the 
target. 
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We  then  explored  the  optimum  combination  of  model  parameters,  settling  on  the  following  values: 

1)  Length  of  the  collector  Lcollector  -  20  m. 

2)  Radius  of  curvature  of  the  primary  mirror  Rprimary  -  3.0  m. 

3)  The  rim  angle  of  the  primary  collector  qRi^  =  80°. 

4)  Width  of  the  secondary  mirror  Wsecondary-  0.6  m. 

5)  Radius  of  the  cylindrical  HCE  Rhce  =  4.375  mm. 

6)  Width  of  flat  plate  HCE  Wriate  =  3.888  cm. 

MODELING  RESULTS 

Figures  4  and  5  compare  the  concentration  achieved  when  the  collector  is  oriented  normal  to  the 
surface  and  when  the  collector  is  tilted  at  latitude,  respectively,  as  a  function  of  the  time  of  day  for 
both  the  flat  plate  and  CPC  absorber  types.  Figures  6  and  7  compare  the  efficiency  achieved  when 
the  collector  is  oriented  normal  to  the  surface  and  when  the  collector  is  tilted  at  latitude,  respectively, 
as  a  function  of  the  time  of  day  of  both  the  flat  plate  and  CPC  absorber  types.  These  graphs  indicate 
that  concentrators  tilted  at  latitude  provide  for  better  year  round  utilization,  winter  concentrations 
being  barely  discemable  for  the  normally-oriented  troughs.  However,  normally  oriented  troughs 
provide  higher  peak  output  and  a  greater  number  of  useful  summer  hours  per  day. 


Fig.  4  (left)  Concentration  of  sunlight  on  target  as  a  function  of  time  of  day.  When  not 
tilted,  the  collector  yields  the  greatest  number  of  useful  hours  and  highest  concentrations  during 
Summer  Solstice.  However,  it  offers  no  concentration  during  Winter  Solstice  due  to  the  angle  of 
the  sun  being  greater  than  the  collector’s  40°  design  limit.  We  also  see  that  the  CPC  offers 
higher  concentrations  than  the  flat  plate  HCE. 

Fig.  5(right)  When  tilted  at  latitude  (35°  see  methodology),  the  collector  maintains 
functionality  throughout  the  entire  year.  Interestingly,  while  the  number  of  usable  hours  is 
reduced  during  Summer  Solstice,  it  actually  increases  during  Vernal  Equinox.  We  also  see  that 
the  CPC  offers  higher  concentrations  than  the  flat  plate  HCE. 
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Fig.  6  (left)  When  not  tilted,  the  collector  yields  the  greatest  number  of  useful  hours 
and  highest  efficiency  during  Summer  Solstice.  However,  the  system  is  not  usable  during 
Winter  Solstice.  We  also  notice  that  the  flat  plate  offers  a  slightly  higher  efficiency  than 
the  CPC  HCE. 

Fig.  7  (right)  When  tilted  at  latitude  (35°,  see  methodology),  the  collector  maintains  functionality 
throughout  the  entire  year.  Interestingly,  while  the  number  of  usable  hours  is  reduced  during 
Summer  Solstice,  it  actually  increases  during  Vernal  Equinox.  We  also  see  that  the  flat  plate  offers 
higher  concentrations  than  the  CPC  HCE. 


Comparison  with  parabolic  trough  concentrators:  land  use  efficiency  and  concentration. 

The  design  proposed  here,  with  an  80°  rim  angle,  achieves  a  peak  efficiency  of  54%  and 
concentrations  up  to  38  suns  over  a  considerable  range  of  incident  angles.  A  conventional  parabolic 
trough  achieves  concentrations  of  71  suns.'®  While  a  single  parabolic  trough  achieves  efficiencies 
near  100%,  troughs  are  widely  spaced  in  a  solar  field  to  avoid  shadowing  when  the  sun  is  lower  in 
the  sky.  Standard  land  use  efficiency  of  a  typical  parabolic  trough  field  is  about  25.8  %, ' '  although 
the  light  use  efficiency  is  higher  when  averaged  over  all  incident  angles.  Because  our  solar  troughs 
could  be  placed  much  closer,  we  could  utilize  a  much  greater  portion  of  the  solar  field.  In  summary, 
our  results  predict  solar  concentrations  and  efficiencies  only  slightly  less  than  solar  fields  of 
conventional  parabolic  troughs. 

CONCLUSION 

We  have  modeled  the  focusing  of  sunlight  onto  a  stationary  target  clement  from  an  immobile 
primary  mirror  of  circular  cross  section  by  means  of  a  smaller  secondary  mirror.  Using  this 
configuration,  with  a  tertiary  concentrator  around  the  target  element,  we  have  achieved  a  peak 
concentration  of  38  solar  equivalents  with  greater  than  50%  peak  efficiency.  Improvements  arc 
possible  with  further  optimization  of  the  shape  and  path  of  the  secondary  mirror,  as  well  as  by 
allowing  the  tertiary  mirror  to  rotate  about  the  target.  It  remains  to  be  seen  how  much  complexity  is 
introduced  with  the  need  to  control  the  position  and  orientation  of  the  secondary  mirror.  In  order  to 
determine  under  which  conditions  our  proposed  design  is  cost  effective,  a  detailed  cost  analysis 
would  be  required. 
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EXPERIMENTAL  UPDATE;  SOLAR  CONCENTRATORS  AND  THERMAL  STORAGE 

More  recently,  we  have  constructed  a  parabolic  mirror  concentrator  (Fig.  8)  and  thermal  storage 
facility  (Fig.  9).  We  chose  a  simple  parabolic  mirror  assembly  over  our  modeled  concentrator  as  a 
first  step  in  order  to  first  gather  experience  in  a  proven  technology.  The  thermal  storage  unit  is  made 
from  locally  available  materials  such  as  sand  and  pumice.  This  construction  and  the  associated  tests 
are  ongoing. 


Fig.  8  Parabolic  Solar  Concentrator.  Width:  8’,  Length:  12’.  The  Parabolic  concentrator  is  made 
from  thin  plywood  bent  over  wooden  ribs.  Steel  piping  runs  through  the  wooden  ribs  lengthwise. 


Fig  9a)  The  solar  thermal  storage  facility  from  above  before  being  filled  with  sand  and  pumice.  The 
outer  cylinder  is  full  of  pumice  as  an  insulator.  The  center  cylinder  is  filled  with  sand,  which  stores 
the  heat.  The  heat  is  distributed  throughout  the  center  by  means  of  pipes  containing  motor  oil.  b) 
After  being  filled  with  sand,  the  top  surface  of  the  storage  unit  is  covered  with  more  pumice  for 
insulation. 
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COMPARATIVE  ANALYSIS  OF  ELECTRIC  CARS  VERSUS  GASOLINE  CARS: 

ENERGY  DENSITY  AND  LIFE  CYCLE  COSTS 


Introduction 

Compared  to  alternatives  including  biofuels,  and  hydrogen  fuel  cell  technologies,  BEVs  (battery 
electric  vehicles)  have  superior  technical  viability,  performance,  existing  infrastructure,  and 
efficiency.  For  instance,  the  present  California  grid  is  capable  of  charging  the  majority  of  the  state’s 
cars  (if  electric)  during  off  peak  hours  with  less  cost  and  GHG  (Greenhouse  Gas)  emissions  than 
would  powering  the  same  number  of  cars  with  gasoline  or  biofuels. 

Yet,  electric  travel  is  often  dismissed  because  the  batteries  are  too  heavy'"*  and  too  expensive.'^  Our 
technical  and  financial  analysis  finds  that  both  of  these  assertions  are  incorrect  when  applied  to  an 
electric  car  of  moderate  range  (~100  miles,  ~160  km).  Such  an  electric  car  would  provide  the 
transportation  needs  of  a  great  majority  of  the  world’s  needs. 

Our  work  was  done  exclusively  with  public  information  on  automobiles,  resulting  in  two 
publications  in  Journal  of  Energy  Policy,  May,  2009: 

•  Batteries:  Higher  energy  density  than  gasoline?  M.  Fischer,  M.  Werber,  P.  V.  Schwartz, 
Journal  of  Energy  Policy,  2009,  37,  2639-2641 : 

http://dx.doi.orti/10. 101 6/i.cnpol. 2009. 02. 030 

•  Batteries:  Lower  cost  than  gasoline?  M.  Werber,  M.  Fischer,  P.  V.  Schwartz,  Journal  of 
Energy  Policy,  2009,  37,  2465-2468:  http://dx.doi.org/10. 101 6/i.enpol. 2009. 02. 045 

Energy  Density.  The  energy  density  of  batteries  is  two  orders  of  magnitude  below  that  of  liquid 
fuels.  “*  However,  this  information  alone  cannot  be  used  to  compare  batteries  to  liquid  fuels  for 
automobile  energy  storage  media.  Because  electric  motors  have  a  higher  energy  conversion 
efficiency  and  lower  mass  than  combustion  engines,  they  can  provide  a  higher  deliverable 
mechanical  energy  density  than  internal  combustion  for  most  transportation  applications. 

The  stored  caloric  energy  densities  of  energy  storage  media,  the  mass  energy  density'^  is  calculated 
as: 


where  Uf\s  the  stored  energy  (lower  heating  value  of  the  fuel  or  battery  energy)  and  mfis  the  mass  of 
the  fuel  or  battery.  However,  the  relevant  energy  is  not  gross  caloric  energy  stored,  but  rather  net 
mechanical  energy’  delivered  to  the  wheels,  tjUf,  where  7]  is  the  “stored  energy  to  mechanical  work” 
conversion  efficiency  and  includes  contributions  from  regenerative  brakes  as  well  as  frictional  losses 
in  the  transmission.  Additionally,  a  motor  and  transmission  is  necessary  to  convert  the  stored  energy 
to  mechanical  work,  so  the  relevant  mass  should  include  the  drive  train  mass,  //?/.  the  motor  or 
engine,  electrical  control  and  power  converters,  transmission,  exhaust,  and  all  associated  parts  and 
fluids.  We  introduce  an  effective  energy  density: 
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nu. 

Pe= - eq.  2 

nif  +  mj 

This  energy  density  depends  on  the  mass  of  the  fuel  or  battery,  which  is  a  function  of  the  range  of 
the  vehicle.  This  effective  energy  density  is  graphed  against  range  for  a  number  of  energy  storage 
media  (Figure  10). 


Range  [km] 


Figure  10  -  Effective  energy  density  for  a  sports  car  according  to  eq.  2.  Although  gasoline  drive 
systems  (black)  reach  much  higher  energy  densities  for  long-range  applications,  electric  drives  have 
higher  energy  density  for  shorter-range  travel.  Batteries  shown:  present  lithium  ion  (red),  theoretical 
maximum  of  lithium  ion  (yellow),  nickel  metal  hydride  (green),  and  lead  acid  (blue) 

Electric  storage  has  a  higher  energy  density  for  shorter  ranges.  Because  the  greatest  majority  of 
automotive  trips  are  short  distances  (see  Figure  1 1),  electric  cars  can  presently  provide  a  significant 
portion  of  humanity’s  travel  needs.  As  electric  storage  technologies  and  charging  infrastructure 
improves,  the  comparative  advantage  of  electric  cars  will  increase. 
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Figure  1 1  -  Portion  of  American  automobile  travel  needs  satisfied  as  a  function  of  automobile  range 
(DOT,  2003).  If  cars  can  be  charged  at  away-from-home  destinations,  cars  with  half  the  full  range 
satisfy  transportation  needs  (red). 


Life  Cycle  Cost  of  Automobile  Transportation. 

Electric  cars  cost  more  than  the  analogous  gasoline  car  -  largely  because  of  the  cost  of 
batteries  (which  increases  with  required  driving  range).  However,  the  maintenance  and  fuel  for 
electric  cars  is  much  less.  We  compared  the  lifecycle  costs  of  an  electric  car  to  a  similar  gasoline 
powered  vehicle  under  different  scenarios  of  required  driving  range  and  cost  of  gasoline.  An  electric 
car  is  cost  competitive  for  a  significant  portion  of  the  scenarios;  for  cars  of  lower  range  and  for 
higher  gasoline  prices.  Electric  cars  with  ~1 50  km  range  are  a  technologically  viable,  cost 
competitive,  high  performance,  high  efficiency  alternative  that  can  presently  suit  the  vast  majority  of 
consumers’  needs.  Using  a  7%  discount  rate,  we  calculated  the  cost  of  miles  traveled  for 
automobiles  over  the  1 2-year  lifetime  driving  1 5,000  miles  annually.  The  costs  were  calculated  as  a 
function  of  desired  range  and  cost  of  gasoline  and  are  shown  in  Figure  1 2. 
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(Conventional  Li)  (Fast  Charge)  Figure  12 


Because  the  vast  majority  of  American  travel  are  short  trips  as  is  shown  in  Figure  1 1  (92%  of 
trips  are  35  miles  or  less),  the  use  of  a  shorter-range,  full  performance  electrical  vehicle  where 
appropriate  can  result  in  considerable  decrease  in  transportation  costs.  Electric  vehicles  have  the 
potential  of  being  less  expensive  while  reducing  both  emissions  (including  greenhouse  gasses)  as 
well  as  dependence  on  oil  purchased  from  unstable/unfriendly  political  regimes. 
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We  neglect  the  volumetric  energy  density,  as  the  volume  of  auto  parts  is  subjective,  and  the  results  will  be  similar  to 
those  relating  to  mass  energy  density. 
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Galvanic  Vestibular  Stimulation  Applied  to  Flight  Training 

Joel  Hanson  -  Dr.  Brian  Self  -  Dr.  Lynne  Slivovsky 
California  Polytechnic  State  University^  -  San  Luis  Obispo 


Abstract 

This  experiment  investigates  if  Galvanic  Vestibular 
Stimtilation  (GVS)  can  be  used  as  an  indicator  of  motion 
sensitivity^  and  explores  the  effects  of  GVS  on  flight 
simulation  performance.  The  motion  sensitivity^  test 
consisted  of  automatically  programmed  alternating 
rolling  stimulations  that  increased  in  frequency  over  time. 
Although  the  stimulations  did  generate  motion  sickness  in 
some  subjects,  the  disorientation  sensations  during  the 
hicreased frequency  transition  did  not  result  in  motion 
sickness  scores  that  had  any  correlation  to  motion  history' 
scores  calculated  from  Kennedy  5  commonly  used  Motion 
Sickness  Questionnaire  (MSQ).  The  flight  simulator  test 
coupled  congnient,  conflicting,  and  sham  orientation 
sensations  to  the  roll  angles  of  the  aircraft.  The  C# 
program  interfaced  X-Plane  data  received  through  the 
UDP  connection  to  the  GVS  device  to  automatically 
generate  corresponding  congruent,  conflicting,  and  sham 
stimulations.  These  stimulations  did  not  have  any  effect 
on  the  simulator  flight  performance  of  the  subjects. 

Although  the  tests  did  not  indicate  specific  ways  to 
test  the  vestibular  system  of  future  pilots,  feedback  from 
the  subjects  during  the  tests  did  raise  question  regarding 
the  optimum  type  of  waveform  for  stimulation.  Subjects 
reported  expecting  specific  orientation  responses  after 
feeling  which  side  of  the  head  current  stimulation  was  on. 
Further  testing  to  reduce  the  surface  skin  sensation 
showed  that  a  ramp  or  increasing  exponential  waveform 
not  only  reduced  the  sensation  of  current  entering  the 
body  but  significantly  increased  the  orientation  sensations 
resulting  from  the  stimulation.  Increasing  the  orientation 
response  and  decreasing  the  sensation  of  current 
breaking  the  surface  of  the  skin  provides  a  much  more 
desired  stimulation  for  each  of  the  tests  in  this  experiment 
and  any  other  future  tests  related  to  GVS. 

1.  Introduction 

Spatial  disorientation  (SD)  is  “the  mistaken 
pereeption  of  one’s  position  and  motion  relative  to  the 
earth”  [21].  Between  1994  and  2003,  spatial 
disorientation  resulted  in  at  least  202  aireraft  aeeidents, 

1 84  of  them  resulting  in  fatalities  [21].  What  eauses 
people  to  beeome  disoriented?  Are  eertain  people  more 
suseeptible  to  SD  than  others?  Are  there  ways  to  safely 
and  eost  effieiently  test  someone’s  response  to 
disorientation? 

Galvanie  vestibular  stimulation  (GVS)  provides  a 
safe,  eost  effeetive  way  to  simulate  spatial  disorientation. 
Cal  Poly,  in  eoordination  with  the  Aerospaee  Medieine  & 
Vestibular  Researeh  Laboratory  (AMVRL)  at  Mayo 


Clinic  in  Arizona,  have  outlined  two  research  objectives 
applied  to  flight  training.  The  first  objective  investigates 
whether  GVS  can  be  used  as  a  test  for  individual 
susceptibility  to  motion  sickness.  The  second  objective  is 
to  explore  the  effects  of  GVS  coupled  with  a  visual 
stimulus  (presented  by  a  flight  simulator)  on  the  human 
vestibular  system.  Each  of  these  objectives  has  the 
potential  to  provide  safe  and  eost  effective  training  for 
pilots. 

2  Motion  Sickness  Susceptibility  Experiment 

The  first  experiment  was  conducted  to  sec  if  applying 
alternating  GVS  currents  can  help  predict  susceptibility  to 
motion  sickness.  Figure  1  -  System  block  diagram 
for  the  motion  sensitivity  test  consisting  of  the 
GVS  Device  and  the  GVS  Software  shows  the 
basic  system  design  used  for  performing  this  test,  which 
consists  of  the  subject,  the  GVS  device,  and  the  custom 
software. 


Figure  1  -  System  block  diagram  for  the  motion 
sensitivity  test  consisting  of  the  GVS  Device  and  the  GVS 
Software 

2.1  Motion  Sickness  Susceptibility  Design 

The  GVS  device  was  purchased  from  Good 
Vibrations  Engineering  in  Toronto,  Canada.  The  GVS 
communicates  with  the  custom  software  through  an  RS- 
232  bluetooth  or  serial  connection.  The  software 
automatically  controls  the  GVS  to  generate  sensations  of 
rolling  left  and  right.  The  incremental  rolling  sensations 
start  out  slowly,  with  8  seconds  between  alternating  roll 
sensations.  The  stimulations  roll  left,  roll  right,  roll  left, 
and  roll  right  with  a  constant  8  seconds  between  each  roll 
sensation.  Then  the  pattern  is  repeated  with  the  time 
period  between  each  stimulation  decreased  from  8 
seconds  to  6,  4,  2,  and  1  second  sequentially.  Figure  2 
shows  a  graphical  representation  of  the  spacing  between 
each  stimulation  during  the  Motion  Sensitivity  Test. 
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Motion  Sensitivity  Test 

♦  Roll  Left*  Roll  Right 


an  individual  is  to  motion  sickness.  These  scores  will  be 
compared  to  the  sickness  scores  resulting  from  the 
rocking  sensations  generated  during  the  motion  sensitivity 
test. 


♦  « ■  ♦  ■  ♦  ■  ♦  MIH 

0  20  40  60 

Time  (Seconds) 

Figure  2  -  Motion  Sensitivity  Test.  Blue  dot  represents  a 
roll  left  sensation  and  a  red  dot  represents  s  roll  right 
sensation. 

Between  each  incremental  stimulation  sequence  the 
subject  indicates  a  status  of  motion  sickness  with  the 
following  sickness  scale:  0:  no  symptoms;  1:  any 
symptoms,  however  slight;  2:  mild  symptoms,  e.g., 
stomach  awareness  but  not  nausea;  3:  mild  nausea;  4: 
mild  to  moderate  nausea;  5:  moderate  nausea  but  can 
continue;  6:  moderate  nausea  and  want  to  stop  [13]. 
Figure  3  shows  the  corresponding  stimulation  sequence 
recording  of  the  electrode  activity  on  the  oscilloscope. 


Agilent  Tectinologiee 


icgpl 


Figure  3  -  Lab  Recording  of  Motion  Sensitivity  Test: 
milliamp  1  second  pulses 


As  explained  further  in  section  2.2,  each  subject 
completes  a  Motion  Sickness  Question  (MSQ)  prior  to 
any  testing.  The  MSQ,  developed  by  Robert  Kennedy 
[16],  provides  a  standardized  motion  sickness  score  for 
each  subject.  The  scoring  in  this  experiment  used 
MSSQA,  representing  the  sickness  score  prior  to  age  12, 
and  MSSQB,  representing  the  sickness  score  in  the  last  10 
years.  These  scores  were  calculated  using  the  following 
equations: 

2.64  X  (total  sickness  score  child)  X  9 
MSSQA  ^ number  of  t\qpes  expenenced  as  a  child) 

2.64  X  (total  sickness  score  adult)  X  9 
MSSQB  ^niunber  of  t^pes  experienced  as  an  adult) 


2.2  Motion  Sickness  Susceptibility  Procedure 

The  procedures  were  explained  to  the  subject  and 
informed  consent  was  obtained,  then  the  subject  filled  out 
the  motion  sickness  questionnaire  (MSQ).  In  addition  to 
ensuring  the  subject  passes  all  exclusionary  criteria,  the 
MSQ  providesa  motion  sickness  score  based  on 
standardized  Kennedy  MSQ.  The  subject  was  then 
connected  to  the  GVS,  which  stimulates  sensations  of 
yaw,  pitch  and  roll. 

The  motion  sensitivity  test  was  administered  in  the 
dark.  The  subjects  closed  their  eyes  and  placed  their  feet 
together  while  standing.  After  every  two  rocking 
sensations  the  subject  was  asked  on  a  scale  of  0-6  how 
they  felt  in  terms  of  motion  sickness.  The  responses  to 
each  stimulation  sequence  were  documented.  After  the  5^^ 
rocking  sequence,  the  rocking  continues  for  30  seconds  or 
until  the  subject  requests  to  stop.  The  subject’s  final 
motion  sickness  score  was  recorded. 

2.3  Motion  Sickness  Susceptibility  Results 

All  subjects  in  the  motion  sensitivity  test  reported 
sensations  of  rocking  back  and  forth.  Figure  4  shows  the 
sickness  scores  for  each  of  the  subjects  at  the  different 
rocking  frequencies.  The  labels  on  the  right  indicate 
scores  for  each  subject.  The  plot  also  shows  the  average 
of  all  the  scores  at  each  rocking  frequency  and  the  linear 
trend  of  the  average. 


Sickness  Score  vs  Rocking  Period 
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The  raw  motion  sensitivity  score  is  equal  to  MSSQA 
+  MSSQB  [12].  The  higher  the  score  the  more  susceptible 


Figure  4  -  Motion  Sickness  Score  associated  with  the 
varying  rocking  frequency  tests 
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Figure  5  shows  the  final  sickness  score  reported  after 
the  test  versus  the  MSQ  score,  and  also  includes  two  red 
circles  around  data  points  on  the  plot.  These  two  subjects 
both  reported  feeling  nausea  after  they  had  completed  all 
testing  procedures.  Both  of  these  subjects  also  reported  a 
metallic  or  battery  acid  taste  in  their  mouths  after  testing. 


Final  Sickness  Score  vs  Motion 
Sickness  (MSQ)  Score 
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Figure  5  -  Final  Sickness  scores  of  the  subjects  versus  the 
motion  sickness  scores  of  the  subjects 


3.  GVS  Coupled  Flight  Simulator  Design 

The  second  experiment  was  conducted  to  explore  the 
effects  of  the  GVS  stimulations  coupled  with  a  visual 
stimulus  on  the  vestibular  system.  In  this  experiment  X- 
Plane,  a  flight  simulator  (www.x-planc.eom),  provided 
the  visual  stimulus.  The  system  design  for  this  experiment 
included  additional  computers  shown  in  the  block  system 
design  in 

Figure  6. 


Figure  6  -  System  block  diagram  for  the  X-Plane  Virtual 
Flight  Simulator  including  the  GVS,  the  GVS  software,  a 
computer  running  X-Plane  controlled  by  the  subject,  and 
a  computer  running  the  X-Plane  chase  plane. 

3.1  GVS  Coupled  Flight  Simulator  Design 

Figure  7  shows  the  dimensions  for  the  flight 
simulator  setup.  In  this  test,  it  was  important  to  try  to 
minimize  visual  references  outside  of  the  flight  simulator. 
The  simulator  image  was  projected  on  the  wall  in  a  dark 
room  with  no  windows. 


®'-°"  I  Screen  Width  f 

Figure  7  -  Flight  simulator  dimensional  room  setup 

The  subject  is  seated  8  feet  6  inches  from  the  wall. 
The  projector  is  2  feet  behind  the  subject  and  3  feet  6 
inches  off  the  ground.  The  projected  image  is  2  feet  8 
inches  off  the  ground  and  6  feet  wide.  This  setup  provides 
a  large  visual  stimulus  for  the  subject  during  the  flight 
simulation. 

Each  subject  completes  the  three  X-Planc  flight 
simulator  tasks  explained  in  Table  1 :  VS-A,  VS-C,  and 
the  Chase  Plane  task.  The  VS-A  and  VS-C  tasks  are 
modeled  off  of  actual  flight  training  maneuvers  from  the 
FAA’s  Instrument  Training  Handbook  [25].  The  tasks  arc 
designed  to  orient  each  subject  with  the  common  flight 
instruments  and  provide  basic  flight  training.  Table  1 
describes  each  task  in  detail. 

During  the  tasks,  the  GVS  stimulates  congruent, 
conflicting,  and  sham  sensations.  The  Congruent 
stimulation  profile  stimulates  sensations  congruent  to  the 
aeromodel  roll  and  pitch  angles.  If  the  aircraft  rolls  right, 
the  subject  is  stimulated  to  feel  like  they  roll  right.  The 
Conflicting  profile  stimulates  sensations  conflicting  with 
the  roll  and  pitch  of  the  aircraft.  If  the  aircraft  rolls  right 
the  subject  is  stimulated  to  feci  like  they  roll  left.  The 
Sham  test  provides  a  low-level  stimulation  that  the  subject 
can  feel,  but  should  not  generate  any  sensations.  The  three 
profiles  are  administered  in  random  order  for  each  flight 
task  to  mitigate  training  effects.  The  threshold  for  both  the 
roll  and  pitch  sensations  is  +/-  10  degrees.  If  the  roll  or 
pitch  angle  exceeds  the  threshold,  a  corresponding 
stimulation  begins  until  the  angle  drops  below  that 
threshold.  Before  running  subjects,  a  moek-up  of  the 
system  was  set  up  using  resistors  and  an  oscilloscope. 
Figure  8  plots  the  roll  values  and  the  corresponding 
electrode  stimulation  during  this  moek-up  of  the  Chase 
plane  task  for  the  three  stimulus  patterns:  (a)  Congruent, 
(b)  Conflicting,  and  (e)  Sham. 
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VS-A: 

Heading:  North 

Airspeed:  100-200  Knots 

Altitude  (changes  +/-  1,000  ft) 

Bank  (constant  at  0) 

Task: 

-Start  at  4,000  ft  and  climb  to 

5,000  ft  at  pitch  angle  of 

10  ®  to  30  °  degrees. 

-Hold  5,000  ft  for  15  seconds 
-Decrease  altitude  back  down 
to  4,000  ft  at  pitch  angle 
of-10"to  -30". 

-Hold  4,000  ft  for  1 5  seconds. 

-Repeat  sequence. 

VS-C: 

Heading:  Changes  with  bank 

Airspeed:  Changes 

Altitude  (changes  +/-  1 ,000  ft) 

Bank  (+/-  30 ") 

Task: 

-Start  at  4,000  ft  and  climb  to 

5,000  ft  at  pitch  angle  of 

1 0  "  to  30 "  degrees, 
maintain  30  "  bank  right. 

-Level  aircraft. 

-Decrease  altitude  back  down 
to  4,000  ft  at  pitch  angle 
of-10"to  -30" 
maintain  a  30  "  bank  right. 

-Hold  4,000  ft  for  1 5  seconds. 

-Level  aircraft  and  repeat 
sequence  with  30 "  bank 
left. 

Chase 

Plane: 

The  final  test  is  to  follow  the  path  of 
a  pre-programmed  chase  plane. 

Table  1  -  VS-A,  VS-C,  and  chase  plane  task  profiles 


Electrode  Voltages  in  Response  to  Roll  Angle 
♦  Roll  Data  ■  Electrodel  A  Electrode  3 


15:53  15:56  15:59 

Time  (Hour  :  minute  :  second) 


(a)  Congruent  Test  Roll  stimulations 


Electrode  Voltages  in  Response  to  Roll  Angle 
♦  Roll  Data  ■  Electrodel  A  Electrode  3 


16:01  16:04  16:07 


Time  (Hour :  minute  :  second) 


(b)  Conflicting  Test  Roll  Stimulations 


Electrode  Voltages  in  Response  to  Roll  Angle 
A  Roll  Data  ■  Electrodel  A  Electrode  3 
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(c)  Sham  Test  Roll  Stimulations 


Figure  8  -  Roll  stimulations  generated  from  Chase  Plane 
test.  The  Congruent  and  Conflicting  stimulations  are  at 
1 .5  milliamps  and  the  Sham  test  is  at  0.5  milliamps. 
Electrode  1  voltage  was  measured  across  a  1  KQ  resistor 
and  Electrode  3  voltage  was  measured  across  a  3  KQ 
resistor,  (a)  Congruent  Roll  Stimulations  (b)  Conflicting 
Roll  Stimulations  (c)  Sham  Roll  Stimulations 


In  Figure  8  the  roll  angles  of  the  chase  plane  are  on 
the  left  vertical  axis  and  the  associated  electrode  voltages 
are  on  the  right  vertical  axis.  A  change  in  roll  angles  only 
activates  electrode  1  and  electrode  3. The  Congruent  and 
the  Conflicting  stimulations  are  at  1 .5  milliamps  and  the 
Sham  stimulation  ias  at  0.5  milliamps.  The  sham  test  is 
always  one-third  the  max  current  selection.  Electrode  1 
voltage  was  measured  across  a  1  KQ  resistor  and 
Electrode  3  voltage  was  measured  across  a  3  KQ  resistor. 
In  the  Congruent  Test  shown  in  Figure  8(a),  if  the  plane 
rolls  right  (positive  on  the  graph)  ,  the  right  electrode 
provides  a  -4.5  voltage  and  the  left  electrode  generates  a 
1 .5  voltage.  The  voltage  polarities  are  reversed  for  roll 
left  (negative  roll  angle).  In  the  Conflicting  Test  shown  in 
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Figure  8(b),  these  voltages  are  opposite  the  eongruent  test 
and  therefore  generate  a  eonflieting  sensation.  In  the 
Sham  Test  shown  in  Figure  8(e),  Eleetrode  1  provides  0.5 
volts  and  Electrode  3  generates  1.5  volts  for  any  roll  angle 
above  10  degrees. 

To  complete  each  task  the  subject  flies  a  Cirrus  Jet, 
shown  in  Figure  9.  This  jet  was  selected  because  it 
provides  a  balance  between  control  and  sensitivity. 


Figure  9  -  Cirrus  Jet  used  for  all  of  the  X-Plane  simulator 
tests 

To  complete  the  first  two  tasks  (VS-A  and  VS-C),  the 
subject  must  rely  heavily  on  the  instrument  panel  of  the 
jet.  The  Cirrus  Jet  uses  a  Cirrus  EXP5000  primary  flight 
display.  Figure  10  shows  the  instrument  panel  of  the 
Cirrus  Jet  with  labels  on  the  commonly  used  instruments. 


Figure  10  -  Cirrus  instrument  panel.  (1 )  Airspeed 
indicator:  Knots  (2)  Bank  angle  indicator:  degrees  (3) 
Pitch  ladder:  degrees  (4)  Magnetie  Headings  indicator  (5) 
Altimeter:  feet  (6)  Vertical  Airspeed  indicator:  feet 

The  instruments  used  in  this  experiment  are  the 
airspeed  indicator,  the  bank  angle  indicator,  the  pitch 
ladder,  the  magnetie  heading  indieator,  and  the  altimeter. 
The  airspeed  indietor  measures  the  speed  of  the  aircraft  in 
knots.  The  bank  angle  indieator  graduations  are  at  0,  10, 
20,  30,  40,  45,  and  60  degrees.  The  bank  angle  indieator 
measures  the  roll  of  the  aircraft,  while  the  pitch  ladder 
measures  the  pitch  angle  of  the  aireraft  in  degrees.  This 
measurement  is  taken  with  respect  to  the  horizontal  line 
on  the  indicator.  The  magnetic  heading  indietor  shows  the 
direction  the  front  of  the  aireraft  is  pointing.  This  does  not 
show  the  true  heading  of  the  flight  path  due  to  the 


possibility  of  cross-winds.  The  altimeter  measures  the 
altitude  of  the  aireraft  in  feet. 


3.2  GVS  Coupled  Flight  Simulator  Procedure 

The  initial  procedures  for  this  second  day  of  testing 
were  similar  to  those  for  the  Motion  Sickness 
Susceptibility  tests.  The  procedures  were  explained  to  the 
subject  and  informed  consent  was  obtained.  If  not 
previously  collected,  the  subject  filled  out  the  motion 
sickness  questionnaire  (MSQ).  In  addition  to  ensuring  the 
subject  passes  all  exclusionary  criteria,  the  MSQ  provided 
a  motion  sickness  score  based  on  standardized  Kennedy 
MSQ.  The  aireraft  controls  and  joystick  functionality 
were  explained  to  the  subject.  Each  of  the  tasks  from 
Table  1  were  then  explained  and  practiced  by  the  subject. 
Each  of  the  three  tasks  (VS-A,  VS-C,  and  Chase  Plane) 
was  completed  successfully  by  the  subject  prior  to  being 
connected  to  the  GVS.  After  attaching  the  GVS  system, 
the  subject  repeated  each  task  sequentially  (in  increasing 
order  of  difficulty,  VS-A,  VS-C,  and  Chase  Plane)  with 
eongruent,  eonflieting  and  sham  stimulations  stimulations 
presented  in  random  order). 

3.3  GVS  Coupled  Flight  Simulator  Results 

As  noted  in  the  Table  1,  the  subject  made  two  climbs 
and  two  descents  for  the  VS-A  flight  task.  Figure  1 1 
shows  the  average  magnetie  headings  of  the  subjects 
while  completing  these  tasks  with  the  different 
stimulation  profiles. 

Flight  Test  1  (VS-A)  Heading  Average 

■  26  ■  30  ■  29  ■  24  123  ■  Average 


4 


-12 


PreTest  Congruent  Conflicting  Sham  Test 
Average  Test  Test  Average 
Average  Average 

Figure  1 1  -  Average  heading  values  of  each  subject 

It  should  be  noted  that  if  the  subject  completed  the 
task  correctly  the  aireraft  would  never  roll  past  •  /-  10 
degrees  and  no  stimulations  would  take  place.  Many  of 
the  subjects  were  able  to  complete  the  task  without 
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feeling  any  stimulation.  Root  mean  square  (RMS) 
deviation  was  used  to  analyze  the  performance  of  the 
flight  tasks.  The  formula  used  for  the  RMS  calculations 
is: 


^RMSdev 


~  ^ ideal) 


In  this  case  equal  to  0  degrees  and  O^^pi^  the 

magnetic  heading  of  the  aircraft  sustained  by  the  test 
subject.  The  variable  n  represents  the  number  of  samples. 
Figure  12  shows  the  RMS  deviation  from  0  degrees 
magnetic  North  for  each  of  the  stimulation  profiles. 


Flightiest  1  (VS-A)  Heading  Deviation 

■  26  130  129  124  123  ■  Average 


PreTest  RMS  Congruent  Conflicting  Sham  Test 
Deviation  Test  RMS  Test  RMS  RMS 
Deviation  Deviation  Deviation 


Figure  12  -  Root  mean  square  of  the  deviation  of  each 
subject’s  path  from  the  desired  0  degrees  North 

The  statistical  analysis  of  the  heading  deviations  for 
the  different  stimulations  indicated  that  there  is  not 
enough  statistical  difference  between  the  congruent, 
conflicting,  and  sham  stimulations  to  exclude  the 
possibility  that  the  difference  is  a  result  of  random 
sampling  variability  (p  =  0.162).  The  test  had  a  power  of 
0.203,  signifying  that  the  sample  number  may  be  too  low 
to  detect  and  true  differences. 

The  second  test  profile  with  the  X-Plane  flight 
simulator  was  VS-C.  This  test  required  that  the  subject 
repeat  the  climbs  and  descents  but  this  time  with  a  +/-  30 
degree  bank  angle.  In  this  test  the  subject  is  stimulated 
during  each  climb  and  fall  as  a  result  of  the  bank  angle. 
For  these  trials,  the  bank  angle  was  used  to  examine  the 
performance  of  the  subjects.  To  ensure  that  the  pilots  had 
not  begun  to  level  out,  the  bank  angle  was  examined 
between  4,250  feet  and  4,750  feet.  The  RMS  deviation 
from  30  degrees  within  the  altitude  boundaries  provides  a 
performance  metric  to  compare  between  the  stimulations. 
Figure  13  provides  sample  altitude  and  roll  data  to 
demonstrate  which  roll  values  are  used  in  the  RMS  bank 
deviation  calculation. 
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Figure  13  -Test  2  (VS-C)  techniques  for  extracting  roll 
values  for  the  RMS  roll  deviation  calculation.  XPIane  was 
set  to  output  20  data  points/second.  Every  200  data  points 
corresponds  to  10  milliseconds. 

Figure  14  shows  the  RMS  deviation  from  the  desired 
bank  +/-  30  bank  angles  throughout  the  entire  test.  The 
data  shows  the  deviations  for  the  PreTest,  congruent 
stimulations,  confliction  stimulations,  and  the  sham 
stimulation. 


Test  2  (VS-C)  Bank  +/-  30  total  RMS  roll 
Deviation 
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Figure  14  -  RMS  deviation  of  +/-  30  degree  bank  angle 
for  Test  2  (VS-C) 
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During  the  VS-C,  there  was  no  statistieal  differenee 
of  the  total  RMS  roll  deviation  values  between  the 
congruent,  conflicting,  and  sham  conditions  (p  =  0.346). 
Again,  the  test  had  a  low  power  (0.073). 

The  first  two  tests  were  designed  to  have  the  subject 
use  the  instruments  on  the  aircraft.  The  Chase  Plane  test 
forces  the  subject  to  remove  their  eyes  from  the 
instrument  panel  and  follow  a  pre-programmed  airplane. 
Figure  15  shows  a  sample  two-dimensional  view  of  a 
flight  pattern.  This  plot  begins  on  the  left  side  of  the 
graph,  viewing  the  flight  path  from  beneath  as  if  the 
viewer  was  lying  on  the  ground.  The  paths  arc  similar 
because  of  the  large  distances  represented  on  the  plot. 
Each  of  the  X,  Y,  and  Z  axes  arc  measured  in  meters. 
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Figure  15  Chase  Plane  Test:  two-dimensional  flight 
paths  viewed  from  the  ground. 

In  order  to  maintain  the  turns  the  pilot  must  bank  the 
aircraft.  Figure  16  shows  the  RMS  difference  in  roll  angle 
between  the  chase  plane  and  the  subjects  during  the 
various  stimulation  profiles. 


Test  3  (Chase  Plane)  RMS  roll  Deviation 
from  Chase  Plane  Roll  Angle 
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Figure  16  -  RMS  roll  deviations  for  the  Chase  Plane 


There  was  no  significant  difference  in  RMS  roll 
deviation  between  the  congruent,  conflicting,  and  sham 
stimulations  (p  =  0.630,  powcr=  of  0.05). 

4.  Conclusions 

The  first  objective  of  this  experiment  was  to 
investigate  whether  GVS  can  be  used  as  a  test  for 
individual  susceptibility  to  motion  sickness.  The  GVS  did 
elicit  rocking  sensations  in  all  of  the  subjects,  and  the 
trend  line  in  Figure  4  shows  that  the  motion  sickness 
score  increases  as  the  rocking  frequency  increases. 
However,  the  data  from  Figure  5  show  that  there  was  no 
relationship  between  motion  sickness  score  to  the  final 
sickness  score  reported  after  stimulation.  Two  out  of  the 
three  subjects  with  the  highest  MSQ  scores  did  report 
feeling  nausea  shortly  after  the  experiment.  GVS  can 
evoke  motion  sickness,  and  it  may  be  that  the  frequency 
of  rocking  was  not  fast  enough  to  elicit  motion  sickness  in 
most  of  the  subjects. 

The  second  objective  of  this  experiment  was  to 
explore  the  effects  of  GVS  coupled  with  a  visual  stimulus. 
This  was  done  by  performing  flight  tasks  while  the  GVS 
system  provided  vestibular  stimulations  in  response  to  roll 
data  from  the  flight  simulator.  Congruent,  conflicting,  and 
sham  stimulations  were  used  to  sec  if  the  GVS 
stimulations  affected  flight  performance. 

There  were  no  statistical  difference  found  in  any  of 
the  tests,  but  this  is  to  be  expected  with  such  a  low  subject 
number.  This  initial  pilot  test  demonstrates  that  the  GVS 
can  be  successflilly  connected  to  a  flight  simulator,  and 
that  the  sensations  can  be  controlled  by  the  orientation  of 
the  aircraft. 

The  feedback  of  the  subjects  throughout  the  testing 
provided  valuable  insight  into  areas  that  could  improve 
the  effectiveness  of  GVS  in  both  of  these  applications. 
During  the  motion  sensitivity  test,  the  subjects  indicated 
that  it  felt  as  if  the  stimulations  felt  were  physically 
pushing  them  back  and  forth.  The  cathode  stimulation 
typically  provided  a  shock  sensation  that  the  subjects 
associated  with  a  pushing  sensation.  During  the  VS-C 
flight  tasks,  many  of  the  subjects  began  to  anticipate  when 
the  stimulation  would  happen.  After  banking  the  aircraft  a 
few  times  in  VS-C,  many  of  the  subjects  had  figured  out 
that  the  stimulation  happened  after  they  passed  the 
threshold.  They  then  modulated  their  stick  input  to 
prevent  the  GVS  from  turning  on. 

How  does  this  feedback  relate  to  improving  the 
effectiveness  of  the  stimulations?  First  the  shocking 
sensation  needs  to  be  minimized  or  eliminated.  The  shock 
sensation  not  only  provides  a  distraction  due  to  slight 
discomfort,  but  the  shock  also  serves  as  a  reference  for 
the  subject  to  interpret  their  experiences.  The  subjects  arc 
expecting  to  feel  pushed  after  the  shock  for  the  motion 
sensitivity  test  and  they  expect  to  feel  shocked  after  they 
pass  the  10  degree  threshold  in  the  flight  task.  Redueing 
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or  eliminating  the  shock  will  likely  remove  both  of  these 
factors  associated  with  this  test.  The  second  improvement 
is  to  increase  the  amount  of  orientation  generated  by  the 
GVS.  The  device  stimulates  orientation  during  the  initial 
current  pulse,  but,  according  to  the  subjects,  it  does  not 
provide  significant  orientation  sensations  after  that  the 
initial  pulse.  This  feedback  provides  the  framework  for 
future  work  to  improve  the  experiments. 

5  Future  Work 

After  these  tests  failed  to  show  any  significant 
effects,  different  waveforms  were  investigated  to  elicit  a 
stronger  response.  Pilot  testing  indicated  the  linear 
ramping  waveforms  not  only  lessened  the  shocking 
sensation,  but  generated  a  significant  increase  in  the 
orientation  sensation  for  6  out  of  6  subjects.  The 
orientation  sensation  is  strong  enough  that  the  subjects 
cannot  ignore  the  sensation,  even  while  sitting  in  a  chair 
with  the  lights  on.  This  was  not  true  of  the  square  pulse 
used  in  the  flight  simulator  and  motion  sensitivity 
experiments.  The  ramping  waveforms  reduced  the 
shocking  sensation  enough  for  6  out  of  6  subjects  to 
comfortably  receive  currents  beyond  2  mA.  In  the  motion 
susceptibility  and  the  flight  test  subjects  often  were  not 
able  to  reach  1 .5  mA  because  the  shock  was  too 
uncomfortable  or  too  many  of  their  head  muscles  were 
being  stimulated.  The  ramping  functions  increased  the 
current  necessary  to  stimulate  any  muscles  on  the  head  to 
over  2  mA.  The  square  pulse  waveform  would  begin 
stimulating  muscles  on  the  head  as  low  as  0.7  mA.  The 
larger  range  of  current  levels  is  important  because  all  of 
the  pilot  subjects  had  increased  sensations  as  the  current 
magnitude  was  increased. 

With  the  dramatic  improvements  provided  by  the 
linear  ramping  function,  a  second  waveforms  was  tested. 
An  exponential  waveform  provided  a  sharper  rolling 
sensation  than  the  linear  ramping  function.  It  would  be 
useful  to  implement  a  test  that  charts  the  sensations  of 
many  subjects  to  various  ramping  waveforms  with 
difference  current  magnitudes.  The  information  from  this 
type  of  test  could  be  used  to  generate  more  realistic 
stimulations  during  the  aircraft  flight. 

The  pilot  testing  indicates  that  the  motion  sensitivity 
and  the  flight  simulator  tests  might  show  a  greater 
dependence  on  GVS  stimulation  with  a  more  effective 
waveform.  The  increased  orientation  sensations 
associated  with  the  ramping  waveforms  provide  much 
stronger  and  consistent  orientation  responses.  Even  with 
lower  currents,  pilot  subjects  were  easily  made  dizzy. 
Further  testing  of  the  new  waveforms  would  provide  data 
to  better  program  the  flight  test.  The  ramping  function  can 
potentially  be  used  to  stimulate  quick  and  slow  roll 
changes  resulting  from  the  aircraft,  which  provides 
stronger  sensation  to  the  subjects. 
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Project  Objective 

The  goals  of  this  project  were  to  theoretically  predict  and  experimentally  measure  the  forces  exerted  on 
multiple  microscopic  particles  which  are  trapped  in  optical  tweezers.  The  theoretical  part  involved  a  full 
vectorial  approach  to  light  scattering  and  used  the  computed  fields  to  calculate  the  optical  forces.  The 
experimental  part  used  an  available  optical  tweezers  system  to  measure  the  force  of  a  trapped  sphere  and 
how  the  force  depends  on  the  proximity  of  another  particle.  This  is  important  since  a  number  of  physical 
and  biophysical  studies  have  utilized  optical  traps  in  close  proximity  to  other  particles  in  the  sample  but 
have  not  accounted  for  the  potential  change  in  the  trapping  force  due  to  the  proximal  particle.  The  project 
intersects  DOD  interests  related  to  biological  hazard  detection  and  computational  electromagnetics. 

Current  State 

We  (Nilgun  Sungar  and  John  Sharpe)  used  6  units  of  release  time  each  during  the  fall  quarter  of  2008  to 
work  on  this  project.  Good  progress  has  been  made,  as  explained  in  the  results  section,  and  we  will 
continue  working  on  this  project  during  summer  2009.  An  undergraduate  physics  student  will  also  be 
involved  in  the  experimental  part  of  the  project  and  will  be  paid  through  the  College  Based  Fee  funds 
available  for  summer  research  experience  for  students. 

Results 


Theory  and  computations 

In  order  to  propagate  the  field  through  the  high  numerical  aperture  lens  and  then  the  cover  slip  we  used  a 
plane  wave  decomposition  method  with  the  Ewald  sphere/pupil  function  approach.  In  previous  work  by 
other  groups  [Rohrbach2001],  the  effect  of  the  cover  slip  was  only  accounted  for  by  shifting  the  focal 
plane  and  changes  to  the  vector  components  of  the  field  due  to  its  original  polarization  had  not  been 
accounted  for.  Our  computations  showed  that  inclusion  of  the  polarization  of  the  field  components 
modify  the  field  intensity  in  the  trapping  region,  hence  changing  the  trap  strength.  If  the  distance  between 
the  cover  slip  and  the  trapping  region  is  small,  the  location  of  focal  plane  is  virtually  the  same  with  or 
without  the  inclusion  of  the  polarization  as  shown  in  Figure  1.  It  can  be  seen  however  that  the  intensity  at 
the  focal  plane  when  polarization  effects  are  included  is  lower. 
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Figure  1:  Field  intensity  along  the  propagation  direction  when  the  distance  to  cover  slip  is  10  microns. 
Blue  curve  shows  the  intensity  when  there  is  no  cover  slip,  red  curve  is  using  the  approach  of  Rohrbach 
group,  black  curve  is  when  the  polarization  effects  are  included. 


When  the  distance  between  the  cover  slip  and  the  focal  plane  is  increased,  accounting  for  the  polarization 
effects  produce  quite  different  intensity  patterns.  This  can  be  seen  in  Figure  2  which  shows  the  field 
intensity  in  the  xz  plane  (where  z  is  the  propagation  direction  of  light)  when  the  cover  slip  is  at  30  |im 
from  the  focal  plane. 


(a)  (b) 

Figure  2:  Field  intensity  on  the  xz  plane  where  z  is  the  propagation  direction  of  the  light  when  the 
distance  to  cover  slip  is  30  microns,  without  accounting  for  polarization  changes  through  the  cover  slip 
(a)  and  with  polarization  changes  through  the  cover  slip(b). 

After  computing  the  field  in  the  trapping  region,  the  scattered  field  from  the  dielectric  particle  along  with 
the  original  field  is  used  to  calculate  the  force  on  the  particle.  We  used  Mie  theory  [Rohrbach2005]  to 
calculate  the  scattered  field.  This  theory  involves  matching  the  electric  fields  and  their  derivatives  at  the 
boundary  of  a  spherical  scatterer.  In  order  to  calculate  the  force  on  a  particle  in  the  vicinity  of  another 
particle,  we  applied  Mie  scattering  theory  iteratively.  We  first  calculated  the  scattered  field  due  to  the 
secondary  particle,  and  then  this  scattered  field  along  with  the  original  field  is  used  in  a  second 
application  of  the  Mie  theory  to  obtain  the  net  field  resulting  from  the  scattering  from  the  trapped  particle. 
In  the  first  application  the  direction  of  each  plane  wave  component  of  the  incident  beam  is  expressed  in 
terms  of  Euler  angles.  Then,  using  structural  information  about  the  scatterer,  boundary  conditions  are 
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applied  and  scattering  amplitudes  are  calculated  for  each  scattering  angle.  Since  the  secondary  particle  is 
off-axis,  it  is  more  practical  to  place  the  particle  at  the  origin  and  shift  the  incident  beam.  After  wc 
calculated  the  scattering  amplitudes,  we  shifted  the  scattered  fields  again  to  realign  with  the  trapped 
particle.  Wc  found  out  that  multiple  operations  of  rotating  each  component  of  3-dimensional  vector 
fields  and  then  integrating  over  the  plane  wave  components  of  the  field  is  very  computationally  intensive 
and  takes  a  long  time  to  run  using  MATLAB.  Wc  now  need  to  investigate  other  methods  of  integration 
and  optimization  of  our  programs,  which  wc  anticipate  doing  during  summer  2009. 

Experimental 

A  challenge  in  this  project  was  to  find  a  method  for  reliably  measuring  the  position  of  the  trapped  particle 
with  very  high  accuracy  ('-'1 0  nm)  at  a  data  rate  in  excess  of  1  OOHz.  It  is  this  position  measurement  that 
allows  the  trap  strength  to  be  calculated.  Although  high-speed  position  sensitive  photo-dctectors  (PSDs) 
arc  the  common  choice  for  this  sort  of  measurement,  in  our  case  their  use  is  problematic  since  the  trapped 
particle  is  very  close  to  a  larger  particle.  The  approach  we  took  was  to  measure  the  particle  position  by 
using  a  fast  shuttering  and  high  frame  rate  camera  (from  Basler  Corporation).  Then  using  image 
processing  we  would  be  able  to  follow  the  particle  position  [Sharpe2007].This  camera  communicates  its 
data  through  a  computers  Ethernet  port  and  can  be  controlled  using  the  application  Lab  VIEW.  In  order  to 
utilize  the  camera  wc  had  to  determine  how  to  acquire,  store  and  process  the  images.  For  the  acquisition 
and  storage  part  three  main  LabVlEW  programs  were  employed.  The  first  program  was  simply  to  monitor 
the  field  of  view  of  the  camera.  The  block  diagram  of  the  system  is  shown  in  figure  3.  Camera  parameters 
(such  as  frame  rate,  frame  size  and  gain)  can  be  set  through  LabView  software  or  using  the  National 
Instalments  Measurement  and  Automation  Explorer. 


Figure  3:  Program  used  to  display  the  field  of  view  of  the  Basler  camera. 

In  order  to  grab  a  sequence  of  images  at  high  speed  a  second  program  was  employed.  Although  the 
program  could  in  principal  have  written  the  image  files  directly  to  the  hard-drive  (as  numbered  BMP  files, 
for  example)  we  found  that  this  was  not  fast  enough.  Instead,  we  employed  a  program  that  simply  stored 
all  the  data  in  one  large  ram-based  array.  At  the  end  of  the  acquisition  the  user  is  prompted  to  give  a  file 
name  and  location  and  the  data  was  then  saved  as  a  one-dimensional  binary  file.  This  program  is  shown 
in  figure  4. 


482 


NOOO 14-07- 1-1 152 


P.I. Susan  C.  Opava,  Ph.D. 


Figure  4:  Program  to  acquire  a  sequence  of  frames  (in  this  case  hardwired  at  1500)  from  the  Easier 
camera  and  save  them  to  bitmapped  image  files. 


Figure  5:  Program  to  read  data  stored  in  a  binary  image  file  and  convert  the  data  into  400x400  pixel 
bitmapped files. 

Once  the  data  had  been  saved  it  needed  to  be  rearranged  and  stored  for  further  processing.  The 
rearrangement  involves  reordering  the  data  into  a  two  dimensional  image  format  and  then  we  chose  to 
store  the  data  permanently  as  consecutively  numbered  BMP  files.  This  is  accomplished  with  the  program 
shown  in  figure  5. 
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With  the  data  saved  as  image  files  wc  can  then  carry  out  the  processing  required  to  locate  the  particle 
position.  This  was  done  using  a  program  written  in  MATLAB.  This  program  allows  the  user  to  select  a 
BMP  sequence  and  then  select  the  position  of  the  particle  under  study.  Once  this  is  done  the  particle 
images  for  the  whole  sequence  are  smoothed  and  averaged  and  the  location  of  the  particle  center 
determined  using  a  cross-correlation  method. 

The  output  from  our  tweezers  system  (built  around  a  Zeiss  Axiovert  microscope)  indicated  that  it  was 
quite  stable.  Figure  6  (left)  shows  a  position  vs.  frame  number  graph  for  a  particle  held  strongly  by  the 
optical  tweezers.  The  fluctuations  arc  of  the  order  of  2  nm.  When  the  optical  power  is  was  reduced  to  ~  10 
mW,  the  fluctuations  were  an  order  of  magnitude  greater  (figure  6,  right). 


Figure  6.  Left  panel:  Particle  position  (in  pixels)  for  each  of 2000  consecutive  frames  w  ith  the  I  pm 
poly  sphere  held  tightly  with  the  tw'eezers  (power  into  hack  focal  plane  of  objective  ~  500  mW).  The 
particle  fluctuates  about  +/-0.02  pixels  about  its  mean  position.  This  corresponds  to  a  fluctuation  of  2  nm 
and  is  much  less  than  the  fluctuations  we  expect  to  measure  for  the  proximity  measurements.  Right  panel: 
Particle  position  when  the  particle  is  trapped  with  --I0  mW  into  the  microscope.  Note  that  the  fluctuations 
are  an  order  of  magnitude  larger  than  those  seen  in  the  left  panel. 


We  went  ahead  and  collected  and  processed  data  from  1  pm  diameter  polystyrene  spheres  which  had  been 
trapped  using  a  1064  nm  laser  beam  and  held  close  to  a  1 0  pm  diameter  polystyrene  bead  which  had  been 
immobilized  onto  the  microscope  cover  slip.  We  typically  recorded  2000  frames  at  a  frame  rate  of  250  fps 
and  an  exposure  time  of  <  Sms.  The  trapped  particle  was  held  relatively  “gently”  by  the  optical  tweezers 
(power  into  the  microscope  ~  10  mW)  so  that  the  trapped  particle  exhibited  a  frequency  of  random 
oscillation  of  the  order  of  100  Hz.  This  was  verified  by  the  use  of  the  Stokes  drag  method. 

A  set  of  data  showing  the  trap  strength  as  a  function  of  position  is  shown  in  figure  7.  As  can  be  seen  there 
is  a  great  variability  in  the  data  and  even  with  this  high  number  of  frames  we  were  unable  to  draw  any 
concrete  conclusions  from  the  data.  However,  the  data  does  show  a  trend:  that  is,  closer  than  about  4  pm, 
the  trap  strength  does  appear  to  weaken  by  20%  when  we  compare  the  trap  strength  just  next  to  the 
large  particle  and  far  away  from  it.  This  is  what  wc  would  expect  and  it  is  consonant  with  the  data  wc 
collected  previously  using  a  conventional  CCD.  However,  there  are  some  very  large  excursions  which  wc 
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have  not  yet  tracked  down.  These  excursions  look  like  a  mechanical  drift  or  a  sudden  change  in  the  power 
of  the  laser  but  close  monitoring  seemed  to  indicate  that  this  is  not  happening. 


distance  of  1  micron  sphere  from  edge  of  10  micron  sphere(microns) 


Figure  7.  Square  of  inverse  particle  position  variance  (which  is  proportional  to  trap  strength)  as  a 
function  of  the  distance  from  the  edge  of  the  large  sphere.  Data  is  shown  for  particle  variance  both  in  the 
direction  perpendicular  to  the  line  joining  the  big  and  small  spheres  (triangles)  and  in  the  direction  of  the 
line  connecting  the  big  and  small  spheres  (circles).  The  arrows  indicate  whether  the  small  sphere  is 
moved  toward  or  away  from  the  large  sphere.  From  a  simple  geometrical  optics  argument  we  would 
expect  that  the  trap  strength  might  start  to  weaken  when  the  trapped  sphere  is  closer  than  approximately 
4  pm. 

The  fact  that  the  camera,  having  a  short  exposure  time,  would  be  noisier  than  a  conventional  CCD  camera 
did  not  appear  to  have  a  substantial  effect.  Repeated  sequences  of  frames  showed  fairly  small  variation  of 
the  variance  (comparable  to  the  size  of  the  data  points  in  figure  5). 

What  we  have  decided  is  that  we  really  need  some  independent  method  of  measuring  a  trapped  particle 
position  so  that  we  can  compare  this  with  the  data  from  the  camera.  This  would  clearly  demonstrate  the 
origin  of  the  large  excursions  -  are  they  from  the  camera/image  processing  or  are  they  from  the 
mechanics  of  the  setup.  For  this  we  will  do  a  direct  comparison  of  position  data  obtained  from  the  camera 
with  position  data  obtained  from  a  well  understood  method  -  that  of  the  position  sensitive  detector. 

By  using  a  PSD  to  simultaneously  acquire  position  data  along  with  that  from  the  camera  we  would  be 
able  to  definitely  locate  the  source  of  the  data  spread  that  we  saw  with  the  camera  alone.  This  could  not 
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be  done  with  the  current  setup  for  several  reasons.  First,  the  microscope  we  had  been  using  (a  Zeiss 
Axiovert)  does  not  have  sufficient  ports  for  beam  paths  to  a  camera  and  a  PSD.  An  alternative  would  be 
to  use  the  condenser  lens  as  an  imaging  lens  for  the  PSD,  but  the  condenser  lens  on  the  Zeiss  is  of  low 
numerical  aperture  and  not  suited  for  imaging.  We  would,  besides,  have  to  modify  the  mieroseope. 


We  thus  decided  that  we  would  build  a  new  tweezers  system  since  we  had  a  high  numerical  aperture 
condenser  available  (but  which  would  not  fit  the  Zeiss).  We  have  begun  construction  on  this  setup  and  the 
partially  built  system  is  shown  in  figure  8.  We  will  complete  this  system  over  the  summer  of  2009. 


Figure  8:  Partially  constructed  optical  tw^eezers  system  for  simultaneous  particle  tracking  using  a  CCD 
camera  and  a  high-speed  position  sensitive  detector.  C:  condenser,  O:  objective.  The  PSD  will  he 
mounted  at  the  position  P. 
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Impact  of  the  Neural  Toxin  Paraoxon  on  the  Electrophysiology  of  the 

Neuromuscular  Junction 

(Final  Report) 

Project  Objective 

The  major  objectjve  of  thjs  project  was  the  experimental  validation  of  a  proposed  model 
of  the  neuromuseular  junetion  under  the  influence  of  organophosphate  based  neural- 
toxins.  This  objective  is  being  pursued  to  support  a  researeh  program  that  involves 
development,  and  subsequent  validation,  of  a  theoretieal  model  of  the  neuromuscular 
junction  that  quantitatively  describes  the  impaet  of  organophosphate  based  neural-toxins 
on  the  physiology  of  the  motor  end  plate.  The  basic  hypothesis  behind  this  research  is 
that  a  sufficiently  detailed  model  of  the  neuromuscular  junction  can  be  used  to 
quantify  the  impact  of  organophosphate  based  neural  toxins  on  the  physiological 
functioning  of  the  junction  which  can  be  validated  experimentally  through  the  use  of 
appropriate  electrophysiology  experimental  protocols. 

Major  Project  Objectives 

Objective  I:  Development  of  a  unified  modeling  and  simulation  approach  that 
encompasses  the  biochemical  as  well  as  the  electrical  behavior  associated  with  the 
neuromuscular  junction  in  the  presence  of  acetylcholinesterase  inhibiting  neural 
toxins. 


•  A  combined  simulation  of  the  type  that  has  been  developed  provides  for  a  better 
understanding  of  the  graded  impact  of  neural-toxin  exposure  on  the  motor  end 
plate. 

•  The  first  objeetive  has  been  eompleted  and  is  the  subject  of  the  dissertation  of  one 
of  the  principal  investigator’s  graduate  students  at  Louisiana  Tech  University. 


Objective  2:  Development  of  this  model  in  an  equivalent  circuit  form  whereby  it  can 
readily  be  implemented  in  conventional  circuit  simulator  packages  based  on  SPICE 
(Simulation  Program  with  Integrated  Circuit  Emphasis). 

•  In  the  case  of  the  proposed  study,  the  SPICE  simulation  platform  allows  for  a 
simulation  approach  that  would  encompass  the  neurotransmitter  release,  diffusion, 
neurotransmitter/neural  toxin  reaction  kinetics,  post-synaptic  membrane 
receptor/ligand  reaction  kinetics  and  muscle  fiber  electrical  activity  under  a 
unified  simulation  framework. 

•  Implementation  of  the  model  in  an  equivalent  circuit  form,  as  a  block  (nctlist) 
level  SPICE  model,  would  also  facilitate  development  of  the  circuit  in  silico. 

•  An  equivalent  circuit  model  of  this  type  could  eventually  be  implemented  in 
integrated  circuitry  and  could  function  as  a  front  end  in  a  neural-toxin  detection 
system  used  to  monitor  exposure  of  individual  personnel  in  an  environment  that  is 
considered  potentially  hazardous. 
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•  Developing  a  SPICE  based  simulation  infrastructure  for  the  combined  model 
described  above  is  a  significant  enhancement  to  currently  existing  simulation 
methodologies  available  to  electrophysiologists  such  as  NEURON  and  GENESIS. 

•  The  utilization  of  SPICE,  as  the  simulation  framework,  would  allow  for  the 
simulation  of  hybrid  circuits  that  include  biological  components  as  well  as 
synthetic  electronic  devices  which  could  ultimately  prove  useful  in  the 
development  of  hybrid  biological/synthetic  circuitry. 

•  Work  on  the  development  of  the  equivalent  circuit  model  is  currently  being 
undertaken  by  the  principal  investigator  and  several  graduate  students  associated 
with  the  Electrophysiology  and  Neural  Electronics  Research  Group  (ENERGy)  at 
California  Polytechnic  State  University  (Cal  Poly). 


Objective  3:  Development  and  implementation  of  suitable  experimental 

electrophysiology  protocols  for  validating  the  proposed  unified  simulation  model. 

•  The  animal  model  that  was  utilized  for  this  study  is  the  neuromuscular  junction  of 
the  medicinal  leech  Hirudo  Medicinalis. 

•  The  leech  neuromuscular  junction  is  a  nicotinic  acetylcholinesterase  based 
synapse.  It  is  consequently  expected  that  the  organophosphate  neural  toxin 
paraoxon  will  exhibit  a  measurable  impact  on  the  electrophysiology  of  leech 
motor  end  plate. 

•  The  proposed  experimental  protocol,  shown  in  Figure  1,  is  designed  with  the 
intention  of  measuring  this  effect  indirectly  by  using  a  voltage  clamp  to  maintain 
the  postsynaptic  membrane  at  a  fixed  value  and  measuring  the  change  in  the  time 
course  of  postsynaptic  motor  end  plate  current.  Under  voltage  clamp,  the 
measured  membrane  current  is  linearly  related  to,  and  consequently  an  indirect 
measurement  of,  the  time  course  of  the  postsynaptic  membrane  conductance. 


Figure  1.  Experimental  protoeol  involving  measurement  of  the  time 
eourse  of  the  motor  end  plate  eurrent.  A  eurrent  elamp  mieropipette  is 
used  to  stimulate  the  L  eell  in  the  leeeh  ganglion.  The  resultant  motor 
end  plate  eurrent  is  reeorded  using  a  voltage  elamp  at  the  postsynaptie 
musele  fiber  under  eontrol  eonditions  and  after  exposure  to  the  neural 
toxin  paraoxon. 


•  Development  of  the  leech  ganglion  muscle  wall  preparation  necessary  for  the 
proposed  experimental  protocol  has  been  completed  by  a  graduate  student 
(Chandra  Miller)  who  was  funded  for  this  work  from  the  resources  for  this 
project.  Other  students  (Brenton  Parks)  were  involved  in  assisting  with  the 
development  of  this  protocol  as  well  as  various  laboratory  related  tasks  and  these 
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students  were  also  funded  from  project  resources.  A  digital  image  of  the 
preparation  is  shown  in  Figure  2.  Images  were  captured  using  digital  imaging 
hardware  and  software  that  was  purchased  using  the  project  resources. 


Figure  2.  Digital  images  of  leeeh  ganglion/musele  wall  preparation. 
The  image  on  the  left  shows  the  leeeh  ganglion  with  a  mieropipette 
inserted  into  the  L  cell  for  stimulation.  The  right  image  shows  the 
longitudinal  muscle  fibers  that  are  innervated  by  the  ganglion.  A 
mieropipette  may  be  scene  inserted  in  a  longitudinal  muscle  fiber 
below  below  the  100  pm  scale  bar  on  the  picture. 


•  In  the  protocol,  the  L  cell  within  one  of  the  leech  ganglia  is  stimulated  with 
current  to  control  excitation.  Because  the  L  cell  innervates  muscle  fibers  along 
the  outer  musculature  of  the  animal,  stimulation  of  the  L  cell  will  result  in  end 
plate  post  synaptic  potentials  in  the  muscle  fibers. 
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Figure  3.  Recordings  of  L  cell  action  potentials  (topmost  graph  labeled 
Vm_prm_l)  and  associated  longitudinal  muscle  fiber  membrane 
current  (third  graph  from  top  labeled  lm_prm_2)  for  the  control  (no 
neural  toxin)  component  of  the  experiment. 
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•  By  voltage  clamping  one  of  the  innervated  muscle  fibers,  the  membrane  current 
can  be  measured  which  is  an  indirect  measurement  of  the  variable  membrane 
conductance.  The  data  displayed  in  Figure  3  was  taken  from  an  experiment 
conducted  on  12/19/08. 

•  The  experiments  for  testing  the  impact  of  the  paraoxon  neural  toxin  on  the  motor 
end  plate  are  currently  ongoing. 


Overall  Project  Goals  in  Relation  to  Naval  Funding  Objectives 

This  project  has  resulted  in  the  successful  implementation  of  experimental 
protocols  that  will  be  useful  in  establishing  the  efficacy  of  the  proposed  theoretical  model 
of  the  neuromuscular  junction  under  the  influence  of  organophosphate  based  neural 
toxins. 

If,  from  these  ongoing  experiments,  the  model  is  successfully  validated,  then  the 
potential  exists  to  develop  it  into  an  equivalent  circuit  form  whereby  it  could  be  utilized 
as  a  sub  system  in  a  neural  toxin  detection  instrument  for  the  purpose  of  determining  the 
physiological  impact  of  a  given  quantity  of  neural  toxin  on  an  organism.  The  model  has 
further  potential  for  utilization  as  a  tool  to  determine  the  efficacy  of  therapeutic 
interventions  for  combating  the  effects  of  organophosphate  based  neural  toxin  exposure. 

The  theoretical  work  for  this  project  has  resulted  in  contributions  to  several  other 
research  programs  currently  ongoing  in  the  principal  investigator’s  group  (ENERGy)  at 
Cal  Poly.  While  these  programs  are  ancillary  in  nature  to  the  main  objectives  of  this 
project,  they  are  acknowledged  because  their  successful  development  was  positively 
impacted  by  the  support  for  this  research.  These  publications  included  a  paper  presented 
at  the  IEEE  Engineering  in  Medicine  and  Biology  Society  Conference  in  2008  as  well  as 
a  paper  that  is  currently  under  review  for  the  IEEE  Engineering  in  Medicine  and  Biology 
Society  Conference  for  2009. 
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Environmental  Proteomics:  The  Minimal  Stress  Proteome  in  the  Marine 
Model  Organisms  Ciona  intestinalis  and  C  sa  vignyi- Networks  of  Co- 
Expressed  Proteins 

Final  Report  (2009) 


Results 

During  the  last  year  we  studied  the  proteomic  stress  response  of  the  marine  sea 
squirt  species  Ciona  intestinalis  and  C.  savignyi  in  response  to  salinity  and  temperature 
stress.  The  objective  of  this  project  is  to  describe  the  minimal  stress  response  (MSR) 
that  is  induced  in  response  to  the  macromolecular  damage  caused  by  the  acute  exposure 
to  multiple  stresses.  The  distinction  between  the  biochemical  pathways  common  to  all 
stresses  as  well  as  the  ones  that  are  specific  to  a  particular  stress  provides  valuable 
insights  about  the  common  and  specific  biomolecular  targets  of  each  stress.  In  addition, 
the  characterization  of  the  MSR  leads  to  a  better  description  of  the  behavior  of  system 
properties  and  their  dynamics  in  response  to  perturbations  through  the  environment. 

Such  descriptions  provide  us  with  insights  about  the  properties  that  determine  the 
robustness  and  resilience  of  biological,  specifically  cellular  systems. 

Salinity  stress 

The  characterization  of  the  MSR  requires  a  detailed  analysis  of  the  proteomic 
response  of  Ciona  towards  several  stresses.  We  have  chosen  two  of  the  most  ubiquitous 
stresses:  salinity  and  temperature  stress.  Here  we  report  the  progress  we  made  in 
describing  the  response  to  salinity  (hyposaline  conditions)  and  temperature  stress. 

The  two  Ciona  species  are  found  at  pilings  of  harbors  and  marinas  world-wide  (C. 
intestinalis)  and  in  the  northeast  Pacific  (C.  savignyi)  where  they  are  exposed  to  changing 
salinity  conditions  during  heavy  winter  rains  and  subsequent  run-offs  (Dybem,  1965; 
Hoshino  and  Nishikawa,  1985;  Lambert  and  Lambert,  1998).  For  example,  in  San 
Francisco  Bay  winter  run-offs  can  lower  the  salinity  of  the  water  from  32  %o  to  1 0  %o. 
Massive  die-offs  of  Ciona  populations  occur  during  these  episodes  of  hyposaline 
conditions  that  are  typical  for  the  winter  and  they  are  followed  by  re-colonization  in  the 
spring  (Lambert  and  Lambert,  1998).  Personal  observations  in  the  field  and  embryonic 
studies  (Dybem,  1967;  Marin  et  al.,  1987)  suggest  that  the  two  Ciona  species  differ  in 
their  tolerance  towards  hyposaline  stress  and  that  it  may  be  a  contributing  factor  enabling 
C.  savignyi  to  expand  its  distribution  range  faster  than  C.  intestinalis  (Lambert  and 
Lambert,  2003). 

Salinity  changes  cause  massive  cellular  adjustments  due  to  the  osmotically  driven 
influx  of  water  during  hyposaline  conditions.  The  increase  in  cell  volume  that  follows 
exposure  to  hyposaline  conditions  requires  that  the  cellular  scaffold  be  restructured 
(Pedersen  et  al.,  2001).  Active  volume  decrease  is  facilitated  by  the  efflux  of  inorganic 
ions  such  as  and  Cf  (Okada  et  al.,  2001). 

In  order  to  characterize  the  changes  in  the  proteome  of  Ciona  in  response  to 
hypolsaline  conditions  we  exposed  both  species  to  decreasing  salinities  (100%,  85%  and 
70%)  for  6  h.  Following  the  exposure  to  hyposaline  (or  -osmotic)  conditions  specimen 
were  brought  back  to  1 00%  salinity  to  recover  for  4  h.  A  union  fusion  or  proteome  map 
of  all  the  proteins  detected  through  two-dimensional  gel  electrophoresis  is  shown  for  C. 
savignyi  is  shown  in  Fig.  1 . 
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Figure  1;  ‘Fusion’  gel  that  is  equivalent  to  a  proteome  map  of  fifteen  gel  images  (IPG  gradient: 
pH4-7;  length  of  IPG  gel  strip:  24  cm;  Protein  loaded:  800  pg)  from  whole  animals  (tunic 
removed)  of  dona  savignyi  exposed  to  100%  (control),  85%  and  70%  salinity  for  6  h  followed 
by  4  h  of  recovery  at  100%  salinity  (constant  13°C).  Protein  spots  that  we  identified  are  shown 
with  their  respective  expression  profiles  (p  <  0.05).  N=  5  for  each  salinity  treatment. 

As  shown  in  the  expression  profiles  in  Fig.  1,  levels  of  expression  varied  among 
proteins  that  changed  in  response  to  hyposaline  conditions.  Some  of  the  proteins  are 
cytoskeletal  elements  (actin  isoforms  and  vimentin),  others  are  involved  in  calcium 
signaling  (Ca^^-vector-binding  protein)  or  the  transport  of  hydrophobic  molecules  (fatty- 
acid  binding  protein). 

We  are  currently  elucidating  the  identities  of  the  proteins  that  are  changing  in 
response  to  hyposaline  stress  in  C.  intestinalis.  We  know  that  C.  intestinalis  changes 
about  three  times  as  many  proteins  in  response  to  hyposaline  stress  than  C.  savignyi  (66 
versus  19),  but  we  have  not  identified  all  the  proteins  that  differ. 
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Temperature  stress 

Temperature  is  arguably  the  most  ubiquitous  environmental  factor  influencing 
organismal  biology,  specifically  in  ectotherms  that  rely  on  ambient  temperatures 
(Hochachka  and  Somero,  2002).  For  example,  it  is  one  of  the  main  factors  determining 
the  distribution  range  of  marine  invertebrates,  such  as  intertidal  molluscs  (Tomanek, 
2002;  Tomanek,  2005;  Tomanek  and  Sanford,  2003;  Tomanek  and  Somero,  1999). 
Adjustments  in  global  gene  expression  levels  are  widespread  with  varying  temperatures 
(Podrabsky  and  Somero,  2004).  The  two  Ciona  species  differ  in  temperature  tolerance, 
although  it  is  still  unclear  to  what  degree.  We  have  made  major  progress  in  elucidating 
their  proteomic  response  to  acute  heat  stress.  Here  we  present  the  proteome  map  of  all 
the  protein  spots  that  we  determined  to  be  up-regulated  and  we  were  able  to  identify  with 
mass  spectrometry  in  Ciona  intestinalis  (Fig.  2). 


Figure  2:  Proteome  map  with  spot  identifieations  of  heat-indueed  proteins  (IPG  gradient:  pH4-7; 
length  of  IPG  gel  strip:  24  em;  Protein  loaded:  800  pg)  from  whole  animals  (tunie  removed) 
exposed  to  13°C  (eontrol),  22°C,  26°C  and  30°C  for  2  h  followed  by  6  h  of  reeovery  at  13°C.  We 
detected  over  a  thousand  protein  spots.  N=  6  for  each  heat  treatment  (p  <  0.05). 
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Figure  3:  Expression  profiles  of  four  molecular  chaperones  (PDI-  protein  disulfide 
isomcrase,  caireticuiin  and  heat-shoek  protein  70)  that  showed  statistically  different 
expression  levels  in  Ciona  intestinalis  after  incubation  to  a  heat  shock  in  comparison  to 
the  13°C  control. 

Expression  profiles  of  four  molecular  chaperones  that  stabilize  denaturing 
proteins  during  heat  shock  are  shown  in  Fig.  3.  We  have  also  obtained  and  analyzed  all 
the  gels  for  the  congeneric  species  C  savigny.  The  species  differs  from  C.  intestinalis  in 
that  it  shows  fewer  molecular  chaperones  increasing  expression  after  heat  shock.  We  arc 
currently  in  the  process  of  confirming  all  the  identifications  and  comparing  the  protein 
expression  profiles  of  both  species. 


Summary 

Our  results  show  for  the  first  time  how  a  marine  invertebrate  that  is  closely  related 
to  vertebrates  responds  to  temperature  and  salinity  stress  at  the  proteomic  level.  The 
emerging  patterns  of  protein  expression  present  clusters  that  we  hypothesize  are  proteins 
that  arc  related  by  function  or  biochemical  pathway.  The  methodology  that  we  applied 
opens  a  way  to  a  systems  biology  approach  to  study  environmental  stress  in  marine 
organisms.  The  resulting  protein  expression  profiles  may  be  used  as  indicator  for  specific 
environmental  conditions.  This  approach  can  be  used  in  the  future  to  develop  biomarkers 
or  -sensors  that  arc  indicators  for  a  range  of  environmental  stresses,  e.g.  physical, 
chemical  to  biological.  We  have  been  successful  at  identifying  the  protein  spots  that  arc 
changing  expression  in  response  to  stressful  conditions.  We  are  confident  that  we  will 
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finish  the  analysis  of  the  changes  in  protein  expression  over  the  summer  and  publish  the 
results  by  the  end  of  the  year. 
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Project  Title:  Adaptation  of  the  Bardo  airway  to  the  Intraoral  Mask: 

Innovative  Airway  Management  Devices  working  in  Concert 

Principle  Investigator:  Keith  Vorst,  Ph.D.,  Industrial  Technology  Plastics  and 

Packaging  Department 


1.  Abstract 

The  Innovative  Airway  Management  Kit  will  be  the  result  of  combining  our  previous 
work  on  the  Bardo  Airway  with  the  NuMask’s  revolutionary  breathing  mask  to  create  a 
system  that  provides  a  new  approach  to  emergency  ventilation  of  the  patient. 

We  will  solve  the  clinical  problem  of  breathing  for  an  obtunded  patient  whose  breathing 
cannot  be  assisted  or  controlled  by  use  of  a  conventional  breathing  mask,  either  because 
of  injury  or  anatomic  challenges,  such  as  obesity  (Figure  1). 

As  the  NuMask  differs  from  the  conventional  breathing  mask,  wc  will  design  and  create  a 
modified  version  of  the  Bardo  Airway  that  will  function  with  NuMask.  The  addition  of 
the  Bardo  Airway  to  NuMask  will  afford  decreased  risk  of  dental  and  soft  tissue  damage 
compared  to  the  only  options  currently  available  to  users  of  NuMask. 

We  will  improve  on  previous  methods  of  product  design  and  materials  selection  by  using 
new  Finite  Element  Analysis  software  in  conjunction  with  the  Cad/CAM  software  that  is 
currently  used  for  the  creation  of  such  devices.  This  methodology  should  help  us  to 
reduce  our  development  time  by  decreasing  the  number  of  prototypes  that  must  be 
created  and  tested.  Also,  we  will  leverage  our  previous  investment  in  structural  and 
functional  airway  simulators  for  testing  of  the  few  prototypes  that  will  be  necessary. 

We  will  also  leverage  our  previous  materials  selection  work  to  provide  non-PVC 
alternatives  for  NuMask,  Bardo  Airway,  and  other  airway  devices  that  will  be  both  less 
potentially  toxic  as  well  as  more  environmentally  friendly  upon  disposal. 


A  B  C 


Figure  1:  Conventional  Breathing  Mask  (A),  Intraoral  Mask  (B)  and  Fitment  of 
Intraoral  Mask  (C) 
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2.  Project  significance 

Airway  devices  are  extremely  important  in  maintaining  adequate  oxygen  delivery  and 
carbon  dioxide  elimination  in  patients  in  the  emergent,  urgent,  and  elective  clinical 
settings. 

Relevance  of  the  research/development  area  to  ONR  and  DOD  areas  of  interest 

In  an  era  when  our  military  is  involved  in  multiple  war  theaters  of  indeterminate  duration, 
improvements  in  combat  casualty  care  and  management  are  extremely  important.  The 
dramatic  increase  in  traumatic  brain  injury  and  bum  injuries  over  the  past  five  years  that 
has  resulted  from  the  tactics  of  the  enemy  makes  emergency  airway  management  even 
more  important  than  in  prior  wars.  Also,  this  research  is  critical  to  expanding  the  options 
of  health  care  professionals  (medical,  dental,  nurse  anesthetists,  etc.)  at  the  Department  of 
the  Navy’s  medical  facilities. 

Design  and  materials  determination  for  medical  devices  has  traditionally  involved  many 
steps.  These  steps  have  included  the  design  specification  as  well  as  the  materials 
specification.  These  two  specification  areas  have  been  largely  separate  and  only  come 
together  in  a  rapid  prototyping  or  tme  prototyping  phase. 

Recently,  the  development  of  Finite  Element  Analysis  (FEA)  software  that  can  model  not 
only  the  stmcture  but  the  material  components  of  a  prospective  device  have  become 
available.  This  is  a  relatively  new  field,  and  represents  a  large  potential  opportunity  in 
the  medical  device  arena.  Gaining  experience  with  FEA  has  the  potential  to  make  Cal 
Poly  a  magnet  institution  for  both  medical  device  companies  and  materials  providers, 
such  as  Dow,  DuPont  and  St.Gobain,  with  whom  our  project  team  has  already  established 
a  relationship  during  our  previous  work.  One  of  our  goals  in  continuing  these 
relationships  is  exploring  the  possibility  of  non-government  funding  to  continue  our  work 
as  a  tenant  in  the  Tech  Park. 

In  addition,  gaining  expertise  in  this  new  and  evolving  area  will  provide  a  more  rapid 
development  platform  for  our  work  as  well  as  unrelated  ONR/DOD  projects  that  could 
benefit  from  more  rapid,  lower-cost  development. 

3.  Background/prior  work 

Our  previous  grant  was  aimed  at  improving  force  protection  during  the  acute  injury  and 
post  acute  injury  phase  by  designing  and  developing  a  superior  oropharyngeal  airway 
device  for  use  with  conventional  bag  mask  ventilation.  However,  bag  mask  ventilation 
has  limitations,  especially  in  trauma,  bum  injury,  and  substantial  anatomic  abnormality  of 
the  face  (Figure  2). 
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Figure  2:  Conventional  Bag  Valve  Mask 

Providing  ventilation  and  oxygenation  in  trauma,  with  or  without  bum  injury,  remains  a 
ehallenge  in  the  field,  espeeially  when  faeial  skin  is  dismpted,  preventing  a  seal  adequate 
for  eonventional  bag  mass  ventilation  to  be  sueeessful.’  ^ 

The  goal  of  this  project  was  to  modify  our  previous  deviee  to  be  eompatible  with  intra¬ 
oral  masks,  whieh  must  be  used  when  eonventional  bag  mask  ventilation  is  not  effeetive 
for  elinieal  reasons  in  the  resuseitation  of  the  injured  eombatant  or  eivilian  trauma  victim. 

NuMask  has  overcome  this  and  other  challenges  in  ventilation  and  oxygenation  including 
patients  with  large  faces;  beard,  significant  anatomic  abnormality,  whether  congenital  or 
as  a  result  of  trauma  and/or  bum  injury;  and  obesity  with  their  innovative  design  that 
bypasses  the  route  used  in  eonventional  bag  mask  ventilation  i.e.  the  lips  and  faeial  skin. 

NuMASK^’'*  Intraoral  Mask  (lOM^'^’)  was  selected  as  one  of  two  of  the  selected  HOT 
PRODUCTS  at  the  2007  EMS  Today  Conference  and  is  featured  in  the  June  2007  issue 
ofJEMS. 

NuMask  has  been  on  the  market  for  four  years,  and  is  currently  gaining  widespread 
acceptance,  both  in  private  hospitals  and  academic  medical  centers  such  as 
Harvard/Massaehusetts  General  Hospital. 

However,  NuMask  currently  utilizes  a  Guedel  airway  in  two  sizes,  large  and  small,  to 
keep  the  airway  open  beyond  the  teeth  and  gums.  David  Isagholian,  the  President  of 
NuMask,  fully  understands  the  limitations  of  a  Guedel  style  airway,  including  dental  and 
soft  tissue  damage  and  limited  access  to  the  pharynx  for  suctioning.  Dr.  Isagholian  fully 
understands  the  patient  safety  advantages  offered  by  the  Bardo  airway  and  the  potential 


Stepwise  airway  management  in  the  trauma  patient,  Trauma,  Vol.  6,  No.  3,  177-185  (2004) 

‘  Journal  of  Burn  Care  &  Research.  27(5);757-759,  September/October  2006. 

Keldahl,  Mark  MD;  Sen,  Soman  MD;  Game///,  Richard  L  MD 
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synergy  between  NuMask  and  the  Bardo  airway  that  would  create  an  innovative  and  safer 
method  of  airway  management. 

NuMask  agreed  to  a  collaborative  effort  with  our  Bardo  airway  development  team  to 
create  a  new  Airway  Management  Kit  combining  both  devices.  NuMask  will  supply  us 
with  the  material  specification  and  SolidWorks  file  for  their  device  and  our  team  will  use 
the  SolidWorks  file  of  our  device  and  Finite  Element  Analysis  methodology  to  create  a 
compatible  version  of  our  device  with  NuMask. 

CAM  creation  of  prototypes  based  on  average  anatomic  measurements  that  are  tested  in 
airway  simulators  as  recommended  by  the  Virtual  Disaster  Medicine  Training  Center.^ 
Moreover,  we  have  refined  the  use  of  simulators  in  airway  device  development  beyond 


Figure  3:  AirSim  Anatomic  Simulator  Figure  4:  Laerdal  Functional  Simulator 

4.  Progress  on  Completion  of  Activities 

Activity  1:  Adaptation  of  Bardo  airway  design  to  a  NuMask  compatible  design 

Several  SolidWorks  files  of  the  NuMask  intraoral  mask  and  the  SolidWorks  file  of  the 
Bardo  airway  using  finite  element  analysis  was  used  create  two  compatible  designs,  one 
with  a  unilateral  bite  block  and  one  with  a  bilateral  bite  block  based  on  the  Bardo  airway 
platform. 

Activity  1:  Completed 

The  results  of  this  activity  can  be  found  in  Attachments  1  and  11  “Using  Rapid 
Prototyping  and  Airway  Simulators  in  Airway  Device  Developmenf  ’  and  were  presented 
for  consideration  at  the  13*’’  Annual  Society  for  Airway  Management  Scientific  Meeting 
September  25-27,  The  Palazzo  Resort-Hotel-Casino,  Las  Vegas,  NV. 

Activity  2:  Design  Refinement  and  Prototype  Models 

After  adaptation  of  the  current  design,  work  will  begin  on  a  prototyping  process.  We  will 
then  test  the  prototypes  for  ease  of  insertion/removal,  ability  to  maintain  an  open  airway, 
and  provide  adequate  ventilation  with  an  Ambu  bag  and  NuMask  intraoral  airway  using 


^  Virtual  Disaster  Medicine  Training  Center  (VDMTC) :  Advanced  Airway  Techniques  Part  Two  -  New 
Generation  Supraglottic  Ventilatory  Devices;  8/16/  2007 
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Laerdal  Airway  Simulator.  Based  on  this  testing,  we  will  select  the  best  design  for  mold 
creation  and  deployment  using  the  material  selected  as  a  result  of  the  initial  grant  process. 

Activity  2:  Completed 

The  new  design  has  been  modified  for  adaptation  as  represented  in  Figure  5  below. 
Additional  testing  was  completed  to  further  characterize  properties  necessary  for  fitment 
to  the  NuMask.  The  Bite  Block  requires  an  unusual  combination  of  material  properties 
because  it  consists  of  two  parts  (a  tongue  depressor  and  a  biting  surface)  that  have  very 
different  functions.  In  order  to  make  a  bite  block  that  performs  well  in  the  oral  airway 
device  application,  the  material  from  which  it  is  made  should  have  the  combination  of 
properties  listed  in  Table  1. 


Figure  5.  Bardo  NuMask  Adaptation  Design 


Table  1.  Properties  of  Bite  Block  for  Continuation  in  Part  Patent  Burdumy,  T,  Vorst,  K 
and  Robertson,  B.  Continuation  in  Part  US  DKT  no:  101659. OOOIUSI  Bardo 
Airway  Management  Device 


Shore  D  hardness 

Tensile  strength,  psi 

Tensile  Stress  at  10%  strain,  Psi 

Tensile  strain  at  break,  % 

Flexural  Modulus  at  23  C,  psi 

Tear  Strength  Ib/in 

Vicat  Softening  Temperature, 


Confidential 

Confidential 

Confidential 

Confidential 

Confidential 

Confidential 

Confidential 


ISO  868 
ISO  527 
ISO  527 
ISO  527 
ISO  178 

ISO  34-1  method  B/a 
ISO  306 
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In  order  to  function  properly  in  the  application,  the  flex  force  of  the  bite  block  part  needs 
to  be  in  the  range  shown  below. 

Tongue  Depressor  Flex  Force  (Ibf)...  Confidential . Modified  ISO  604  in 

compression  mode  using  fixtures 
manufactured  at  Cal  Poly 


Activity  3:  Mold  Creation 

A  series  of  prototype  molds  will  be  evaluated  prior  to  a  final  aluminum  mold  for  the 
injection  molding  machine  located  in  the  Plastics  Processing  Laboratory  at  Cal  Poly. 

This  mold  will  be  able  to  produce  commercial  grade  airway  devices  that  can  be  scaled-up 
to  full  production  models. 

Activity  3:  Completed 

A  single  cavity  mold  production  mold  has  been  created  and  used  to  create  1500 
production  samples.  This  mold  has  been  asset  tagged  and  is  currently  at  Plastics 
Engineering  and  Development  Inc.  (PEDI)  Carlsbad,  CA. 

Activity  4:  Creation  of  Airway  Kit 

The  airway  kit  had  been  developed  with  completion  of  FDA  certified  labels  and 
packaging.  This  packaging  is  ready  for  distribution  and  includes  the  NuMask  intraoral 
airway  and  Bardo  airway  for  use  with  conventional  bag  mask  ventilation  methods 
(Attachment  III). 
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Attachment  1 

Using  Rapid  Prototyping  and  Airway  Simulators  in  Airway  Device  Development 

Theodore  Burdumy  M.D.,  MBA,  Keith  Vorst,  PhD,  James  Recabaren,  M.D,  FACS 

Introduction 

In  addition  to  intubation  injuries,  emergenee  elenehing  has  beeome  inereasingly 
reeognized  as  a  souree  of  patient  injury.  Airway  deviees  resting  on  the  eentral  ineisors, 
whieh  ean  withstand  vertieal  forees  of  only  25-35  pounds,  are  the  eommon  denominator 
in  emergenee  elenehing  injury.  The  Ameriean  Soeiety  of  Anesthesiology  reeommends 
that  vertieal  forees  should  be  reloeated  posteriorly  to  the  molars,  whieh  ean  withstand 
vertieal  forees  of  200-300  pounds. 

Methods 

We  designed  an  airway  deviee  whieh  eombines  the  features  of  a  bite  bloek  and  an 
oropharyngeal  airway.  We  studied  the  physieal  properties  of  referenee  materials  eurrently 
used  in  bite  bloek  and  oropharyngeal  airways  to  seleet  a  material  appropriate  to  both 
purposes 

We  evaluated  prototypes  using  the  AirSim  (anatomieal)  and  Laerdal  (funetional)  airway 
simulators.  Fiberoptie  laryngoseopy  was  utilized  to  examine  the  airway-simulator 
interfaee.  Bag-valve-mask,  endotraeheal  tube,  and  laryngeal  mask  ventilation  were 
performed  with  the  Bardo  airway  in  plaee  as  a  bite  bloek.  We  tested  the  Bardo  airway 
both  alone  and  in  eombination  with  advaneed  airway  deviees. 

Thermoplastic  Polyester 

DuPont  HYTREL  SC976NC010  (Hytrel  7246)  -  Properties  Confidential 
DuPont  HYTREL  SC938NC010  (Hytrel  3078)  -  Properties  Confidential 
DuPont  HYTREL  SC945NC010  (Hytrel  4056)  -  Properties  Confidential 

Thermoplastic  Polyurethane 

Bayer  TEXIN  RxT85A  -  Properties  Confidential 

Bayer  TEXIN  Rx90A  -  Properties  Confidential 
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Attachment  II. 


Poster  Presentation 
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Attachment  III 

Overwrap  Dimensions  of  Bardo  Airway  Kit 
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Outside  Dimensions: 
4in  X  6.6in  x  3.42in 
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Honors  Projects 

Structure  Climbing  Robot 

Experimental  Bifurcations:  A  Study  in  Buckling  Beams 
Ion  Thrusters  in  Space 

Modeling,  Analysis,  and  Design  of  Structural  Components  Subjected  to  Severe 
Loading  Conditions 

Probing  the  Surface  of  Lactic  Acid  Bacteria  With  Atomic  Force  Microscopy 
Visualization  of  Decision -Theoretic  Plans 

Implementation  of  Artificial  Neural  Network  for  Control  of  Simulated  Wheeled 
Robot 
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Structure  Climbing  Robot 

Final  Report 

California  Polytechnic  State  University,  San  Luis  Obispo 
Dr.  Saeed  Niku 
Paul  Bessent  (GENE) 

Executive  Summary 

The  Structure  Climbing  Robot  (SCR)  is  a  robot  with  the  ability  to  climb  any  structure. 
The  robot  will  be  about  two  feet  in  length  and  looks  similar  to  a  human  arm;  a  gripper  is  at  each 
end,  connected  by  two  links,  with  an  elbow  in  the  middle. 

The  SCR  will  have  a  total  of  nine  motors:  two  to  open  and  close  the  two  grippers  and 
seven  to  control  the  movement  of  the  SCR.  We  will  use  gear  motors  with  a  worm  gear  on  the 
end  to  control  the  motion  of  the  robot.  The  worm  gear  will  increase  the  torque  of  the  gear  motor 
and  reduce  the  revolving  speed  to  a  usable  amount.  The  motors  will  be  attached  to  composite 
tubes  filled  with  foam  that  make  up  the  body  of  SCR  as  the  two  links.  These  links  arc 
lightweight  so  that  the  motors  will  not  be  overloaded  with  torque.  They  arc  also  very  stiff  so  that 
the  robot  will  not  bend  easily  while  in  motion. 

The  SCR  was  modeled  and  tested  in  the  computer  program  Dymola.  The  simulations  and 
calculations  performed  in  Dymola  determined  the  orientation  of  the  motors  as  well  as  what 
motors  to  use.  The  motors  were  ordered  and  arrived  a  couple  weeks  ago.  The  motors  will  be 
tested  to  detennine  the  size  of  the  worm  gear  needed.  This  research  will  continue  in  the  future. 
After  I  take  some  more  classes,  I  will  design  and  build  the  joints  to  begin  assembling  the 
prototype. 

Introduction 

This  report  is  of  the  progress  on  the  research  done  in  the  spring  of  2008  to  design  a 
functional  and  practical  Structure  Climbing  Robot  (SCR)  that  has  the  ability  to  climb  any 
structure.  The  main  purpose  for  the  SCR  is  to  be  able  to  climb  where  it  is  too  dangerous  or 
difficult  for  a  person  to  go  in  order  to  do  inspections  and/or  maintenance.  Many  groups  have 
attempted  to  build  such  a  robot,  but  there  is  no  known  success.  Two  major  problems  arise  in 
such  a  project.  One  is  to  design  the  best  orientation  of  the  motors  to  achieve  enough  mobility  for 
the  robot  to  climb.  The  second  is  to  keep  the  robot  lightweight  so  that  the  motors  are  strong 
enough  to  move  the  robot. 
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This  quarter  is  a  continuation  of  the  research  done  last  quarter.  The  progress  of  this 
quarter  includes  determining  the  orientation  of  the  motors  and  what  motors  to  use.  The  next  step 
in  the  research  is  fabricating  gears  and  joints  in  order  to  put  the  robot  together. 

Background 

A  similar  project  was  undertaken  by  a  group  at  the  Carnegie  Mellon  University  Robotics 
Institute’s  many  years  ago.  A  report  in  the  1990  Annual  Research  Review  explains  their  findings 
and  what  problems  they  encountered.  The  Self-Mobile  Space  Manipulator  (SM  )  was  designed 
for  the  space  station  in  order  to  perform  routine  inspection,  maintenance,  and  light  assembly. 

The  desire  for  the  SM^  is  because  it  is  a  safer  and  more  cost  effective  alternative  than  using  an 
astronaut. 

The  SM^  has  much  value  to  the  space  station,  but  it  has  many  limitations.  The  design  of 
the  SM^  is  similar  to  a  human  arm.  A  gripper  is  at  each  end,  connected  by  two  links,  with  an 
elbow  in  the  middle.  The  gripper  for  the  SM^  is  a  mechanism  that  screws  into  holes  on  a  truss 
structure.  This  means  that  the  design  is  limited  to  walk  on  the  monkey  bar-like  structure  that 
must  be  made  around  the  space  station.  If  the  truss  structure  is  damaged,  the  SM^  is  not  able  to 
move  everywhere. 

A  1/3  scale  model  of  the  SM^  was  built  and  tested  at  the  Carnegie  Mellon  University. 
Because  the  robot’s  links  are  constructed  out  of  thin-walled  tubing  to  be  lightweight,  the  SM^  is 
very  flexible.  Since  the  SM^  is  to  be  used  in  space  that  has  very  little  gravity,  a  servoed  gravity 
compensation  system  was  developed  to  make  the  testing  similar  to  a  zero  gravity  testing. 

The  SM^  would  not  be  able  to  be  used  on  earth  because  the  force  of  gravity  would  be  too 
much  for  the  flexible  links.  Also,  the  SM^  would  not  be  able  to  be  used  on  a  variety  of 
structures.  The  successful  design  of  a  SCR  that  can  climb  any  structure  would  have  many  more 
uses  on  the  space  station  and  on  earth. 

A  successful  design  of  a  robot  with  a  similar  purpose  is  Dr.  Elon  Rimon’s  spider  robot 
(figure  7  in  appendix).  This  three  legged  robot  can  climb  over  obstacles  and  get  into  places  too 
dangerous  for  people.  This  walking  robot  gives  hope  for  the  success  of  a  SCR. 

Design 

The  basic  design  of  the  SCR  can  be  seen  in  Figure  1  of  the  appendix.  The  design  is  to 
have  two  links  connected  in  the  middle  by  an  “elbow”  with  grippers  at  the  other  end  of  the  links. 
We  have  determined  that  seven  motors  must  be  used  in  order  to  give  the  robot  enough  degrees  of 
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freedom  to  have  full  mobility.  Another  motor  on  eaeh  gripper  is  needed  to  open  and  elose  the 
gripper.  This  means  that  there  will  be  a  total  of  nine  motors  for  the  robot  with  seven  degrees  of 
freedom.  The  orientation  of  the  motors  is  explained  in  the  next  scetion.  Last  quarter,  we 
determined  that  using  composite  tubes  filled  with  foam  as  the  links  (body)  for  the  robot  will  keep 
the  robot  stiff  and  lightweight. 

Method  and  Results 

To  start  the  new  quarter  of  research,  1  quickly  began  testing  different  motor  orientations 
in  the  eomputer  program  Dymola.  We  received  the  program  late  last  quarter  and  so  we  had  not 
done  mueh  work  on  it.  1  first  tested  if  six  motors  (not  ineluding  the  two  gripper  motors)  would 
be  able  to  give  the  SCR  the  full  mobility  neeessary.  After  many  trials  and  errors,  1  was  unable  to 
determine  a  design  that  worked.  The  six  motor  SCR  was  able  to  reaeh  any  point,  but  its  gripping 
ability  was  limited.  At  some  positions,  the  gripper  would  be  stuek  in  its  orientation  and  was  not 
able  to  turn  in  order  to  grab  the  structure  correctly  for  a  firm  grip. 

With  the  failure  of  the  six  motor  SCR,  now  began  the  testing  of  a  seven  motor  SCR.  We 
had  previously  believed  that  this  would  be  ample,  but  we  wanted  to  make  sure  the  seven  motor 
SCR  had  full  mobility.  With  the  design  in  Figure  2,  the  SCR  was  able  to  reach  any  point  and  the 
gripper  was  able  to  rotate  to  any  orientation  for  a  secure  grip  of  any  strueture.  The  grippers  were 
omitted  from  the  Dymola  programming  to  make  the  design  trials  faster  and  easier.  The  red 
eylinders  in  the  figure  represent  the  motors;  the  axis  of  spin  for  a  motor  runs  through  the  eenter 
of  the  circular  faces  of  the  cylinder. 

Although  the  SCR  had  full  mobility,  the  axes  of  spin  of  the  motors  at  the  “wrist”  had  to 
be  arranged  so  that  they  would  interseet.  This  would  later  allow  the  motion  of  the  SCR  to  be 
solved  mathematically  more  easily.  The  initial  design  of  the  SCR  had  the  axes  of  spin  of  two  of 
the  motors  in  the  “wrist”  interseeting  while  the  third  axis  of  spin  was  offset  by  a  small  distance. 
To  determine  a  design  for  the  three  axes  of  spin  to  intersect,  I  examined  some  robots  in  the 
robotics  laboratory  that  had  three  axes  of  spin  interseeting.  I  made  the  adjustments  to  the  SCR 
and  the  SCR  still  had  full  mobility.  This  new  design  also  allows  us  to  reposition  the  two  motors 
elosest  to  the  “elbow”  to  either  be  at  the  “wrist”  or  at  the  “elbow”  as  seen  in  Figure  3  and  Figure 
4,  respectively.  The  programming  that  made  a  simulated  model  of  the  SCR  in  Dymola  ean  be 
seen  in  Figure  5. 
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Now  that  the  design  was  determined,  it  was  time  to  test  what  motors  would  work  best. 
Using  a  table  of  motors  researched  last  quarter,  I  inputted  the  different  weights  of  the  motors  and 
ran  Dymola  to  calculate  the  torque  necessary  to  move  the  robot  at  our  desired  speed.  The 
calculations  were  plotted  on  a  graph  (Figure  6)  as  the  SCR  moved  through  specified  positions. 
The  results  of  the  calculations  showed  that  the  use  of  two  different  motors  would  provide  the 
most  available  torque.  The  extra  torque  could  later  be  used  to  attach  sensors,  cameras,  a  battery, 
and  other  various  items.  The  two  motors  were  heavier  than  what  we  initially  planned,  but  the 
motors  had  the  highest  torque  to  weight  ratio;  this  means  that  the  motors  could  lift  their  own 
weight  better  than  the  other  motors.  This  also  means  that  there  is  more  torque  available  to  attach 
the  sensors,  cameras,  and  other  items. 

With  the  motors  determined,  we  started  the  process  of  buying  the  motors.  We  got  the  “go 
ahead”  to  buy  the  motors,  but  the  website  was  out  of  stock.  I  searched  for  other  websites  but 
they  were  out  of  stock.  I  was  able  to  find  one  of  the  motors,  but  there  was  only  one  motor  left  in 
stock.  I  emailed  dozens  of  companies  looking  for  those  motors  but  had  no  luck.  The  production 
company  was  redesigning  the  motor  and  it  would  not  be  available  until  later  this  year.  They  also 
said  that  there  were  no  substitute  motors.  After  much  research,  I  found  a  similar  motor,  but  it 
had  a  smaller  gear  ratio.  The  smaller  gear  ratio  meant  a  faster  speed  and  less  torque,  but  that  was 
acceptable  because  we  are  planning  to  put  a  worm  gear  on  the  motor  to  reduce  the  speed  and 
increase  the  torque.  The  motors  were  ordered  and  received  shortly  before  the  end  of  the  quarter. 

While  waiting  for  the  motors  to  arrive,  I  continued  the  search  for  a  proper  worm  gear.  A 
worm  gear  is  illustrated  in  Figure  8;  as  the  motor  turns  the  worm  shaft,  the  worm  gear  rotates. 

The  advantage  of  this  type  of  gear  is  that  the  worm  gear  locks  into  the  worm  shaft  without 
putting  a  torque  on  the  motor.  This  means  the  motor  can  be  turned  off  and  the  worm  gear 
(therefore  the  SCR)  will  remain  in  its  position.  Most  of  the  worm  gears  I  found  were  too  small 
or  not  strong  enough.  After  finding  worm  gears  that  could  work,  they  were  too  expensive  for  our 
budget. 

In  search  for  an  alternative,  we  proposed  matching  a  screw  to  a  gear.  This  would  be  less 
efficient,  but  possibly  much  cheaper.  With  a  gear  in  stock,  I  was  able  to  match  the  pitch  with  a 
lag  screw.  The  screw’s  threads  were  not  deep  enough  to  get  secured  contact  between  the  screw 
and  the  gear.  1  met  with  George  Leone  of  the  Mechanical  Engineering  Department  about  cutting 
the  threads  deeper  and  he  was  confident  it  could  be  done.  For  future  work  on  the  SCR,  the  worm 
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gears  need  to  be  made  after  the  correct  ratio  is  determined.  Tests  will  soon  be  done  on  the 
motors  to  determine  how  much  torque  is  available  at  what  speed.  This  will  allow  us  to  calculate 
the  gear  ratio  needed  for  the  worm  gear. 

Furthermore,  the  joints  need  to  be  designed  and  fabricated.  However,  I  have  not  taken 
the  classes  that  would  help  with  those  aspects.  I  am  planning  to  take  a  design  class  in  the  fall 
since  1  have  now  fulfilled  the  prerequisites.  I  will  also  try  taking  classes  to  learn  how  to 
machine.  1  may  Join  the  rose  float  building  team  or  Team  Tech  to  get  more  machining 
experience.  While  catching  up  with  those  classes,  I  may  skip  taking  HNRS  200  in  the  fall  but 
continue  working  on  the  SCR  as  much  as  I  can. 

Conclusion 

The  tests  performed  on  Dymola  have  determined  a  working  design  for  the  orientation  of 
the  motors.  Using  the  six  motor  design  did  not  give  the  SCR  full  mobility,  but  the  seven  motor 
design  provided  full  mobility.  Also,  the  three  motors  that  make  up  the  wrist  were  designed  such 
that  the  three  axes  of  spin  from  the  motors  intersect.  The  specifications  of  a  list  of  motors  were 
tested  in  Dymola  for  the  SCR  model.  It  was  determined  that  two  of  the  heavier  motors  would 
work  better  due  to  their  high  torque  to  weight  ratio.  After  some  trouble  with  ordering  the 
motors,  the  motors  arrived  recently  and  will  be  tested  soon. 

The  upcoming  work  for  the  SCR  research  will  be  to  design  and  build  the  worm  gears  and 
joints.  I  will  be  learning  those  skills  as  quick  as  I  can  which  may  pause  the  progress  of  the  SCR. 
I  still  plan  to  continue  the  research  and  hope  to  build  a  prototype  in  the  near  future. 
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APPENDIX 


Figure  1.  Basic  model  of  SCR 
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Figure  3.  Final  SCR  motor  orientation  design  Figure  4.  Alternate  motor  orientation 
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Figure  5.  Dymola  programming  for  SCR 
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CatcuMing  Torque  of  Motors 


Figure  6.  Calculation  of  torque  on  motor  in  Dymola 


Figure  7.  Dr.  Elon  Rimon’s  spider  robot 
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Figure  8.  Worm  gear 
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Experimental  Bifurcations:  A  Study  in  Buckling  Beams 

Addison  Cugini — Physics  Major 
John  Sharpe — Advisor 
Executive  Summary 

This  study  in  experimental  bifurcations  involved  loading  a  beam  with  increasing 
amounts  of  weight;  the  deflection  angle  of  the  beam  after  it  buckles  was  then  measured 
using  a  laser.  The  angle  of  deflection  should  increase  in  a  parabolic  fashion  after  the 
beam  buckles.  This  project  was  done  in  an  attempt  to  develop  an  experiment  to  be  used 
in  a  course  in  non-linear  dynamics.  By  addressing  the  effects  of  shortcomings  in  our 
initial  experimental  design  such  as  friction,  a  wobbly  rig,  and  a  damped  base,  we  were 
able  to  create  a  deflection  curve  which  closely  followed  the  expected  appearance  of  an 
imperfect  pitchfork  bifurcation. 

Introduction 

The  purpose  of  the  project  was  to  make  an  experiment  that  would  measure  the 
angle  of  deflection  as  a  function  of  load  for  a  buckling  beam  around  its  critical  load.  The 
measure  of  this  angle  of  deflection  should  qualitatively  and  quantitatively  illustrate  a 
supercritical  pitchfork  bifurcation  in  the  immediate  post-buckling  range.  We  tried  to 
repeat  the  work  of  John  Roorda,  who  did  a  similar  experiment  in  the  1960’s.  Our 
research  was  done  for  the  purpose  of  creating  a  lab  demonstration  that  eould  be  used  to 
enrich  courses  in  non-linear  dynamics. 

Background 

Bifurcations  are  a  major  part  of  the  study  of  dynamical  systems  and  involve  the 
sudden  change  of  qualitative  behavior  when  a  parameter  is  changed  slightly  beyond  a 
certain  critical  value.  One  such  type  of  bifurcation  is  the  supercritical  pitchfork 
bifurcation,  the  solutions  of  which  look  something  like  a  parabolic  pitchfork. 

A  supercritical  pitchfork  bifurcation  is  normally  of  the  form  x'  =  rx  -  x^,  where  r  is 
the  control  parameter.  A  top  loaded  Euler  Strut  or  vertical  beam  can  be  modeled  as  two 
rigid  rods  held  together  by  a  spring.  Using  gravitational  and  spring  potential  energy  a 
mathematical  model  can  be  developed  such  that:  U  =  '/2  k0^  +  P  L  cos  0.  Where  0 
represents  the  angle  of  deflection,  P  is  the  load  applied  to  the  strut  which  acts  as  the 
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control  parameter  and  L  is  the  height  of  the  center  of  mass.  One  can  then  differentiate  the 
equation  in  order  to  find  the  points  at  which  net  forces  are  equal  to  zero.  Using  the  first 
two  terms  for  the  Taylor  expansion  of  sine,  it  can  be  shown  that  U'  =  0(k  -  P  L)  -  (P  L/6) 
0^  Thus,  this  model  suggests  that  an  Euler  Strut  exhibits  the  mathematical  characteristics 
of  a  supercritical  pitchfork  bifurcation  in  the  immediate  post-buckling  range.' 

While  the  theory  is  fairly  straightforward,  the  actual  implementation  of  this  theory 
in  experimental  form  is  difficult  because  the  bifurcation  occurs  with  weights  close  to  the 
critical  load  value.  Therefore,  there  is  a  need  for  the  development  of  an  experiment  which 
can  accurately  illustrate  the  pitchfork  bifurcation  of  an  Euler  Strut. 

Design 

Our  first  design  involved  clamping  the  base  of  a  strut  (made  of  tensile  steel  1 2in  x 
l/16in  X  1  in)  to  a  table  and  using  a  pillow  block  to  guide  a  rod  onto  the  top  of  the  beam. 
We  then  placed  dead  weights  onto  the  shaft  to  induce  a  bifurcation  and  recorded  the 
angle  of  deflection  by  reflecting  a  laser  off  the  beam  and  onto  a  wall.  The  deflection 
angle  and  load  were  then  displayed  on  a  scatter  plot  and  checked  for  consistency  with  the 
theoretical  predictions.  Research  was  done  to  improve  this  basic  design. 

Our  inquiry  focused  largely  on  the  use  of  different  experimental  techniques  to 
load  the  strut  with  weights;  the  loading  technique  needed  to  have  low  friction  and  ensure 
an  even  perpendicular  force  so  that  the  actual  loads  could  be  accurately  recorded  and 
compared  to  deflection  data. 

Experimentation 

The  initial  set  up  had  a  number  of  flaws  which  caused  it  to  produce  results 
inconsistent  with  the  qualitative  appearance  predicted.  The  single  pillow  block  design  did 
not  provide  a  rigid  enough  shaft  for  the  rod  to  go  through;  this  meant  that  the  force  was 
not  applied  perpendicular  to  the  ground  and  could  not  be  measured  with  the  accuracy 
demanded  by  this  experiment.  To  remedy  this,  two  pillow  blocks  were  aligned  using 
connector  rods  and  the  weight  applying  shaft  was  guided  through  producing  a  rig  that 
would  not  wobble  as  weights  were  added.  It  took  a  number  of  fine  tuning  adjustments  to 
ensure  that  the  pillow  blocks  were  in  line  with  one  another  and  would  not  cause  the  shaft 
to  jam  or  experience  large  amounts  of  friction.  Also,  oil  was  added  to  the  shaft  to  reduce 
the  friction  even  more. 
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Initially,  the  set  up  also  had  the  misgiving  of  eausing  torsion  on  the  beam  making 
it  difFieult  to  tell  exaetly  how  mueh  the  defleetion  had  ehanged  as  weight  was  inereased; 
the  laser  beam  would  refleet  off  at  different  angles  due  to  this  torsion.  The  torque  on  the 
beam  may  have  also  eaused  minor  imperfeetions  whieh  eould  alter  the  overall  appearanee 
of  the  defleetion  eurve,  invalidating  our  results.  In  response  to  this,  we  loaded  the 
weights  in  sueh  a  way  that  would  not  nudge  the  loading  shaft  as  this  would  eause  the  rod 
to  twist. 

Clamping  down  the  base  of  the  strut  led  to  the  rod  not  buekling  in  the  manner  that 
was  dietated  by  our  model.  The  mathematieal  representation  of  the  system  treats  the 
beam  like  two  ridged  rods  eonneeted  at  the  eenter  by  a  spring  hinge.  This  situation  did 
not  at  first  elosely  follow  reality;  the  bottom  seetion  of  the  beam  was  remaining  relatively 
vertieal  when  weight  was  added.  To  fix  this  problem,  we  serewed  a  ‘V’  shaped  wedge 
into  the  table  and  plaeed  the  strut  into  the  wedge.  This  would  allow  the  beam  to  buekle 
easier  as  the  wedge  aeted  like  a  hinging  joint. 

Results  and  Discussion 

After  tweaking  our  experimental  design  with  these  modifieations,  we  were  able  to 
attain  a  parabolie  shape  when  eomparing  load  and  defleetion  on  a  seatter  plot  as  seen  in 
the  following  graph.  Beeause  of  small  initial  imperfeetions  in  the  beam,  this  graph  does 
not  entirely  eonform  to  the  idealized  “perfeef  ’  pitehfork  bifureation.  Instead  of  the  strut 
buekling  at  one  partieular  load,  it  slowly  buekles  at  first  and  then  defleetion  starts  to  grow 
quiekly  where  the  buekling  would  be  expeeted  to  oeeur.  This  is  eharaeteristie  of  an 
imperfeet  pitehfork  bifureation  that  already  has  an  initial  defleetion  angle  before  loading. 

Deflection  Vs  Load 
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In  order  to  see  whether  the  buckling  beam  was  in  fact  an  imperfect  system,  we 
measured  the  opposite  deflection  angle;  that  is  to  say,  we  looked  at  the  deflection  angle  if 
the  beam  buckled  in  the  opposite  direction.  One  can  see  in  the  graph  below  that  the 
opposite  deflection  angle  is  not  symmetric  with  the  other  angle.  It  is  only  able  to  establish 
a  stable  equilibrium  on  the  opposite  side  after  a  significant  amount  of  load  is  applied  to 
the  strut.  This  “snap-through”  is  consistent  with  what  one  would  see  in  an  imperfect 
system. 


Deflection  vs  Load 


Conclusion 

By  altering  our  initial  design  to  accommodate  for  factors  such  as  friction,  torsion, 
a  wobbly  loading  device,  and  a  clamped  base,  we  were  able  to  develop  an  experiment 
that  qualitatively  illustrated  an  imperfect  pitchfork  bifurcation.  This  improved 
experimental  design  is  ready  to  be  used  in  a  class  setting  to  help  teach  non-linear 
dynamics. 

In  the  future,  it  would  be  best  to  further  improve  the  set  up  by  fine  tuning  the 
loading  mechanism  to  be  more  precise.  One  could  do  this  by  replacing  the  pillow  blocks 
(which  guided  the  loading  shaft  onto  the  strut)  with  bushings.  These  bushings  have  small 
ball  bearings  in  them  which  allow  for  fluid  motion  that  would  all  but  remove  friction. 
Also,  a  micrometer  could  be  used  to  measure  the  weight  being  applied  more  accurately 
and  provide  a  better  deflection  graph.  We  would  also  like  to  try  to  get  a  beam  that  has 
hardly  any  initial  imperfections  and  would  thus  illustrate  a  “perfect”  bifurcation.  These 
adjustments  would  mean  that  the  experiment  could  be  done  with  greater  accuracy. 
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Ion  Thrusters  in  Space 

Josh  Fernandes,  Physics 
Greg  Stratton,  Aerospace  Engineering 


Introduction: 

Ion  thrusters  are  a  relatively  new  mode  of  space  transportation  that  carry  a  large 
potential  in  the  fields  of  long  distance  missions  within  the  solar  system  and  long  term 
station  keeping  for  a  spacecraft.  In  this  research,  we  are  seeking  to  optimize  the  size  and 
placement  of  the  magnets  for  performance  of  the  ion  thruster.  This  involves  building  test 
models  and  testing  them  in  the  vacuum  chamber  on  campus  in  order  to  collect  data  for 
the  graduate  students’  master’s  thesis. 

Background: 

Electric  ion  propulsion  acts  as  a  mode  of  moving  around  in  space,  but  doesn’t 
play  a  role  in  traveling  from  earth  to  space.  Ion  propulsion  takes  an  ion  gas  and  directs  it 
with  magnets  to  a  strong  electric  field,  where  the  ions  accelerate  quickly  and  propel  the 
spacecraft.  NASA  first  tested  an  ion  thruster  in  a  laboratory  in  1960,  but  the  thruster  was 
not  used  in  space  until  NASA’s  Deep  Space  1  Mission  in  1998'.  Deep  Space  1  employed 
its  ion  propulsion  to  travel  a  far  distance  in  space,  which  is  what  the  ion  engines  were 
initially  used  for.  Ion  thrusters  are  ideal  for  many  deep  space  missions  because  they  carry 
a  very  high  ISP,  which  is  essentially  gas  mileage  for  a  spacecraft.  Ion  thrusters  don’t 
create  much  thrust  but  can  fire  for  long  periods  of  time  in  order  to  produce  very  high 
speeds.  The  main  alternative  to  ion  thrusters  for  these  missions  is  chemical  rockets, 
which  have  a  higher  capacity  for  thrust  but  a  lower  ISP. 

In  addition  to  deep  space  missions,  station  keeping  also  finds  use  in  ion 
propulsion.  Station  keeping  involves  keeping  the  satellite  in  the  correct  orbit  and  pointed 
in  the  correct  direction.  These  smaller  ion  thrusters  currently  have  very  little  research 
behind  them,  so  they  are  excellent  for  testing  for  improvements.  Cal  Poly,  San  Luis 

^  Brophy,  John  R.  “NASA’s  Deep  Space  One  Ion  Engine”  September,  2001. 
jet  Propulsion  Laborator\\  Pasadena,  California. 
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Obispo  recently  received  valuable  materials  from  the  Jet  Propulsion  Lab  in  order  to 
research  these  ion  propulsion  systems. 

Theory: 

The  basics  of  ion  thrusters  are  not  very  difficult  to  grasp,  but  they  do  require  some 
understanding  of  physics.  The  thruster  is  basically  a  chamber  shaped  like  a  bottle  with 
one  end  open  with  a  metal  grating  at  that  end.  The  other  end  has  a  cathode  which  emits 
electrons  into  the  chamber,  which  is  filled  with  a  gas.  When  the  electrons  hit  the  gas,  the 
gas  turns  into  ions  or  charged  particles.  Magnets  on  the  outside  of  this  chamber  direct  the 
ions  to  the  opening  of  the  bottle,  where  there  is  a  strong  electric  field.  When  the  ions  hit 
the  electric  field,  they  accelerate  quickly  to  the  outside  of  the  bottle,  which  creates  thrust 
or  moves  the  spacecraft.  The  experimental  literature  shows  that  ion  thrusters  most 
commonly  use  Xenon  gas  for  the  ions  because  of  its  large  mass  and  low  corrosive 
properties.  Ion  thrusters  also  commonly  fire  for  several  months  at  a  time.  Most  of  the 
research  on  ion  thrusters  has  been  performed  on  larger  thrusters,  so  there  is  very  little 
information  on  thrusters  like  the  size  that  we  are  researching. 

Methods,  Results,  and  Discussion  of  Work  to  Date: 

So  far,  almost  all  of  our  discussion  and  work  has  revolved  around  building  and 
acquiring  materials  for  a  test  model  to  collect  data  from.  This  has  been  a  tedious  process 
because  we  have  had  to  work  around  manufacturing  companies  and  shipments  in  order  to 
acquire  the  needed  materials.  Our  first  task  was  to  find  aluminum  bottles  that  matched 
the  required  dimensions  and  was  under  a  reasonable  price.  We  searched  online  and 
discovered  an  excellent  test  bottle,  but  we  didn’t  purchase  it  because  the  manufaeturing 
company  required  a  minimum  purchase,  which  was  $470.  This  set  us  back,  but  wc 
searched  again  and  recently  purchased  a  suitable  bottle  so  that  we  may  begin  construction 
of  the  test  model.  While  we  were  working  on  this,  the  two  graduate  students  focused  on 
repairing  the  vacuum  chamber,  which  we  shall  be  using  for  the  tests  on  the  ion  thruster. 
These  repairs  are  nearly  complete,  so  we  may  soon  only  focus  on  building  the  test  model. 
Meanwhile,  we  have  been  obtaining  clearance  and  practicing  with  the  tools  needed  for 
construction  of  the  test  model  in  the  aerospace  hanger  on  the  Cal  Poly  campus.  This 
hanger,  which  is  staffed  by  the  mechanical  engineering  department,  requires  a  short 
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safety  course  in  order  to  obtain  permission  to  use  the  tools  that  they  have.  We  have 
recently  required  this  permission  and  are  ready  to  begin  the  building  process  of  this 
research. 

Future  Plans: 

Once  we  get  the  ion  thruster  assembled,  and  the  vacuum  chamber  running  again, 
we  will  start  testing  the  ion  thrusters.  While  testing  the  ion  thruster,  we  will  be  looking 
for  ways  to  increase  the  efficiency  of  the  thrust.  The  magnets  we  will  be  using  are 
movable,  and  we  will  be  attempting  to  figure  out  how  many  rings,  and  how  far  apart 
those  rings  must  be  to  maximize  thrust.  We  will  present  any  information  we  find  out  to 
JPL,  and  hopefully  they  will  find  it  useful  in  building  their  own  ion  thrusters. 

Conclusion: 

We  have  learned  a  lot  through  this  quarter  of  study.  We  have  learned  how  to  build 
an  ion  thruster,  and  how  an  ion  thruster  works.  We  also  understand  the  physics  that 
allows  an  ion  thruster  to  work.  To  allow  ourselves  to  work  on  the  ion  thruster,  we  learned 
how  to  safely  operate  the  metal  working  machinery  necessary  to  cut  the  bottles  the  ion 
thruster  is  made  of. 
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Vacuum  Chamber 
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Appendix  B: 

Ion  thruster  ready  to  test  in  vaeuum  ehamber 


Thnnt»r  S*tup  Clo$»-up  Vl»w 
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CALIFORNIA  POLYTECHNIC  STATE  UNIVERSITY,  SAN  LUIS  OBISPO 

Modeling,  Analysis,  and  Design  of  Structural  Components  Subjected  to  Severe  Loading  Conditions 

Deborah  Go  -  Civil  Engineering 
Steven  Wancewicz-  Mechanical  Engineering 


Summary 

This  study  focused  on  analyzing  the  earthquake  simulation  software  OpenSees.  We  recorded  design 
parameters  and  test  results  from  former  experiments  that  had  evaluated  the  behavior  of  exterior,  knee,  and 
eccentric  joints  under  severe  loading  conditions.  We  then  entered  the  collected  data  into  and  ran 
OpenSees  in  order  to  compare  the  accuracy  and  consistency  of  the  OpenSees  model  with  the  actual 
experimental  results. 


Introduction 

The  purpose  of  this  project  is  to  test  analytical  models  for  reinforced  concrete  beam  column  joints  subjected 
to  seismic  conditions.  Post-earthquake  reconnaissance  as  well  as  experimental  investigations  reveal  that 
joints  affect  the  stiffness  and  strength  of  the  structure  and  might  also  lead  to  structural  collapse.  Analytical 
modeling  of  joints  with  a  wide  range  of  design  parameters  allows  a  better  understanding  of  force  transfer 
within  the  joint  and  the  failure  mechanisms.  Moreover,  mathematical  modeling  allows  for  various  joint 
designs  to  be  analyzed  under  different  loading  conditions  in  much  less  time  and  at  a  much  lower  cost 
compared  to  experimental  investigations. 


Background 

In  a  2003  study  by  Lowes  and  Altoontash,  a  model  was  developed  that  simulated  the  behaviors  of 
reinforced  concrete  interior  column-beam  joints  under  severe  loading  conditions.  This  model  was  later 
improved  upon  by  Mitra  and  Lowes  in  2007  to  more  accurately  simulate  the  aforementioned  behaviors  of  a 
wider  range  of  interior  joints.  We  will  apply  the  proposed  new  model  to  exterior,  knee,  and  eccentric  joints. 

To  start,  reinforced  concrete  is  concrete  reinforced  with  metal.  There  are  two  components  to  the  reinforcing 
metal.  First,  steel  bars  provide  additional  strength  and  flexibility  to  the  concrete.  The  number  of  steel  bars  in 
a  beam  or  column  affects  the  strength  of  the  joint  and  therefore  must  be  included.  Second,  hoops  are 
spaced  around  the  steel  bars  to  keep  them  in  place.  The  spacing  and  size  of  hoops  are  additional  factors 
that  must  be  included  in  the  model. 
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Figure  1.  Simple  representation  of  an  exterior  joint. 

An  exterior  joint  is  universally  found  and  therefore  important  to  be  able  to  model.  As  shown  in  Figure  1,  the 
beam  is  perpendicular  to  the  column.  In  addition,  one  end  of  the  beam  coincides  with  the  center  of  the 
column.  An  exterior  joint  can  also  be  referred  to  as  a  T-joint. 


While  not  as  many  knee  joints  generally  exist  in  a  structure  as  exterior  or  interior,  the  initial  failure  of  just 
one  joint  could  cause  a  structure  to  collapse.  Therefore,  all  joints  including  a  knee  joint  are  important.  A 
knee  joint  is  similar  to  an  exterior  joint,  except  one  end  of  the  beam  connects  to  one  end  of  the  column 
instead  of  the  middle  of  the  column  as  in  an  exterior  joint.  A  simplified  beam-column  knee  joint  is  shown  in 
Figure  2.  While  researching  reinforced  concrete  knee  joints,  authors  also  referred  to  a  knee  joint  as  an  L- 
joint  ora  corner  joint. 


532 


N00014-07-1-1152 


P.l. Susan  C.  Opava,  Ph.D. 


^  [4^  Joint  eccentricity 


Figure  3.  Eccentric  Joint. 

Another  part  of  this  project  is  to  test  the  applicability  of  the  model  on  eccentric  column-beam  joints,  shown 
in  Figure  3.  An  eccentric  joint  is  a  joint  where  a  column  and  a  beam  of  different  depths  are  aligned  so  that 
one  column  face  is  flush  with  one  beam  face,  and  therefore,  the  centerline  of  the  column  is  not  aligned  with 
the  centerline  of  the  beam.  During  conditions  like  those  created  by  an  earthquake,  this  eccentricity  results 
in  the  development  of  torsion  forces  that  do  not  develop  in  concentric,  or  non-eccentric,  joints. 

A  model  for  simulating  joint  failure  helps  engineers  perform  quicker  and  less  expensive  analysis  before  a 
structure  is  built.  If  the  model  incorrectly  calculates  data,  an  entire  structure  could  collapse.  Therefore,  it  is 
important  to  test  the  model  by  comparing  already  collected  experimental  data  to  data  simulated  by  the 
model. 


Methods 

We  began  the  project  by  performing  some  background  research  on  the  types  of  joints  with  which  we  would 
be  working.  Dr.  Mitra  provided  each  of  us  with  several  papers  pertaining  to  eccentric,  exterior,  and  knee 
joints.  The  papers  required  specific  attributes  in  addition  to  just  being  the  respective  joint.  For  example,  a 
knee  joint  research  paper  needed  to  be  about  knee  joints  made  of  reinforced  concrete  that  had  rectangular 
cross  sections.  After  reading  through  these  papers  and  developing  a  firm  understanding  of  our  respective 
joints,  we  took  note  of  key  forces,  properties,  and  dimensions  that  are  relevant  to  the  response  of  a 
reinforced  concrete  beam-column  connection  during  severe  loading. 

Although  Dr.  Mitra  had  already  provided  us  with  a  few  research  papers,  we  gathered  more  papers  using 
search  engines  such  as  Engineering  Village,  by  searching  specifically  for  experiments  that  tested  the 
response  of  reinforced  concrete  joints  when  subjected  to  earthquake-like  forces.  Once  we  collected  a 
substantial  number  of  experimental  research  papers,  we  used  the  aforementioned  list  of  key  parameters  as 
a  guideline  to  extract  data  from  each  paper,  recording  the  data  in  an  Excel  spreadsheet.  For  each  paper, 
we  would  note  the  properties  and  dimensions  of  each  tested  specimen  and  the  behavior  of  the  specimen 
during  testing. 
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The  next  step  in  the  project  was  to  create  an  analytical  model  with  source  code.  Dr.  Mitra  provided  both 
students  with  the  source  code  to  use  in  OpenSees.  The  OpenSees  source  code  is  written  in  the  tcl/tkl 
(pronounced  “tickle”)  language,  which  is  specific  to  OpenSees.  While  OpenSees  has  a  wide  application  of 
uses,  the  purpose  of  this  project  is  to  use  the  program  to  analyze  exterior,  knee,  and  eccentric  joints.  The 
source  code  was  opened  in  a  program  called  Crimson  Editor.  The  beams  and  columns  are  initially  being 
analyzed  separately  to  create  a  full  analysis  of  the  joint  based  upon  all  components  and  how  all  the 
components  react  to  given  forces.  Once  the  information  for  a  given  beam/column  has  been  recorded,  the 
code  will  be  executed  in  OpenSees.  Operating  OpenSees  involves  using  a  few  basic  command  lines:  one 
to  run  the  file,  and  one  to  clear  variables  to  run  the  next  file. 

The  next  step  in  the  project  was  to  use  the  collected  data  from  OpenSees,  which  is  a  minimum  of  six 
separate  text  files  per  beam  and  column,  and  make  use  of  the  data  to  discover  how  stiffness  is  affected  as 
the  beam  degrades.  There  are  two  materials  that  could  fail  in  the  joint:  concrete  or  steel.  A  yield  strength 
corresponding  to  each  steel  reinforcement  bar  was  recorded  in  excel  and  will  again  be  utilized  here.  The 
concrete  was  assumed  to  have  yielded  with  a  value  of  0.003  mm/mm.  A  result  from  one  beam  can  be 
shown  in  Figure  5. 


Results 

An  example  graph  is  shown  below  in  Figure  5.  The  graph  shows  a  moment-curvature  relationship  for  the 
beam.  The  point  on  the  plot  where  it  seems  to  suddenly  veer  right  on  the  graph  demonstrates  the  yield 
point  of  the  beam.  Since  the  red  square  (representing  steel)  is  around  this  point,  steel  is  the  reason  the 
beam  would  fail.  Therefore,  if  the  beam  were  to  be  strengthened,  the  steel  would  have  to  have  a  higher 
value  for  its  yield  strength.  The  corresponding  moment  on  the  y-axis  signifies  the  maximum  moment  the 
beam  could  be  subjected  to  and  the  curvature  is  the  angle  in  radians  that  the  beam  would  be  from 
horizontal  after  such  a  moment  is  applied. 
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Figure  5.  Example  of  Graphical  Results. 

Future  Research 

While  these  graphs  are  very  informative,  more  work  is  still  necessary  to  find  a  relationship  between 
stiffness  and  the  applied  moment  and  ultimately  determine  when  the  joint  will  fail.  So,  while  plotting  these 
graphs  utilizing  matlab,  another  property  was  recorded,  the  lever  arm  for  the  beam  section  and  column 
section  that  were  in  compression.  With  this  property,  properties  from  recorded  in  the  spreadsheet,  and 
additional  source  code  provided  by  Dr.  Mitra,  the  joint  is  finally  ready  to  be  analyzed. 


Conclusion 

In  conclusion,  we  have  learned  a  lot  since  starting  the  project.  At  first,  it  was  a  great  challenge  to  extract 
numbers  from  articles.  As  time  passed  and  Dr.  Mitra  provided  more  question  sessions,  both  Deborah  and 
Steven  became  better  at  extracting  data  from  articles.  The  vocabulary  and  general  knowledge  of  joints  will 
help  in  further  classes  and  our  future  careers  as  engineers. 

The  future  of  the  project  is  currently  uncertain,  as  Steven  will  no  longer  be  able  to  work  on  the  project  and 
Deborah  is  pursuing  other  interests. 
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Honors  200  Final  Report 

Probing  the  Surface  of  Lactic  Acid  Bacteria  With  Atomic  Force 

Microscopy 

Nicole  Olson,  Biochemistry 


Executive  Summary 

The  goal  of  this  project  was  originally  to  determine  how  the  growth  media 
of  lactic  acid  bacteria  affects  its  adhesion  forces.  The  part  that  we  needed  for  the 
atomic  force  microscope  (AFM)  to  be  able  to  study  the  adhesion  forces  hasn’t 
arrived  yet,  so  we  were  forced  to  alter  our  goal.  Instead,  we  have  been  studying 
four  different  strains  of  lactic  acid  bacteria,  obtaining  images  of  each,  and  trying  to 
find  observable  differences  between  them.  However,  the  end  goal  of  the  project  is 
still  to  be  able  to  analyze  the  adhesion  forces  of  different  strains. 

I  spent  the  majority  of  the  quarter  learning  how  to  use  the  AFM.  1  was  able 
to  begin  imaging  the  four  strains  of  bacteria  during  the  last  two  weeks,  but  1  didn’t 
have  enough  time  to  draw  any  conclusions  about  the  observable  differences 
between  the  strains.  My  accomplishment  this  quarter  has  been  becoming 
competent  using  the  AFM  more  than  analyzing  the  bacterial  strains  themselves. 

Introduction 

We  wanted  to  determine  if  lactic  acid  bacteria  cultured  in  the  presence  of 
lipids  and/or  proteins  from  the  milk  fat  globule  membrane  (MFGM)  have  stronger 
adhesion  forces  than  those  grown  without  MFGM  material.  Our  hypothesis  was 
that  the  presence  of  MFGM  material  in  the  culture  media  enhances  the  probiotic 
effects  of  the  bacteria  as  well  as  makes  the  adhesion  forces  that  the  bacteria  have 
to  the  intestinal  epithelium  stronger.  Since  we  couldn’t  measure  the  adhesion 
forces,  we  decided  to  study  four  different  strains  of  lactic  acid  bacteria  instead. 

The  four  strains  that  we  studied,  NCFM,  NCFM  LaCl,  NCFM  SlpA  KO,  and 
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1063-S,  are  all  used  widely  in  the  food  industry  as  probiotie  additives  in  dairy 
produets.  The  main  things  that  we  started  to  look  at  while  determining  differences 
between  strains  was  the  size  and  shape  of  the  bacteria.  We  were  able  to  note  these 
different  characteristics  by  using  the  AFM. 

Background 

The  AFM  was  first  introduced  in  1986.  Since  its’  creation,  it  has  become 
the  foremost  tool  for  measuring,  manipulating,  and  imaging  matter  at  the 
nanoscale.  The  AFM  is  a  type  of  scanning  probe  microscope  and  consists  of  a 
microscale  cantilever  with  a  tip  (probe).  When  the  tip  comes  close  to  the  surface, 
the  cantilever  bends.  By  aligning  a  laser  so  that  it  is  focused  off  of  the  end  of  the 
cantilever  and  then  reflected  onto  some  photodiodes  that  are  connected  to  a 
detector,  the  AFM  is  able  to  measure  the  height  of  various  samples.  To  avoid 
damaging  the  tip,  the  AFM  utilizes  a  feedback  mechanism.  The  feedback 
mechanism  works  by  adjusting  the  distance  between  the  tip  and  maintaining  a 
constant  force  between  the  tip  and  the  sample.  As  the  cantilever  and  tip  move 
back  and  forth  across  the  surface,  a  height  image  is  able  to  be  obtained  because  the 
movements  of  the  laser  are  recorded  by  the  photodiodes  and  then  relayed  to  the 
detector,  where  an  image  can  be  put  together.  When  scanning,  piezo  crystals  are 
responsible  for  moving  the  cantilever  very  small  distances  in  the  x,  y,  and  z 
directions. 

This  project  has  been  a  collaborative  effort  between  The  Chemistry  and 
Biochemistry  and  The  Dairy  Products  Technology  Departments.  While  previous 
research  has  already  been  done  on  the  three  NCFM  strains,  our  project  attempted 
to  examine  the  bacteria  on  a  molecular  level.  The  AFM  has  been  a  great  aid  by 
allowing  us  to  obtain  high-resolution  images  of  samples  on  the  nanoscale.  The 
NCFM  strain  is  a  wild  strain  of  lactic  acid  bacteria.  The  NCFM  LaCl  strain  is  a 
mutant  of  NCFM,  which  has  been  genetically  modified  to  produce  P- 
galactosidase.  The  NCFM  SlpA  KO  strain  is  another  mutant  of  NCFM,  which  has 
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been  genetically  modified  so  that  its’  S-layer  surface  protein  isn’t  produced.  The 
1063-S  is  known  as  lactobacillus  reuteri,  and  is  found  in  the  gut  of  mammals  and 
birds. 

Methods  and  Theory 

In  order  to  be  able  to  image  the  bacteria,  we  first  had  to  prepare  slides  with 
the  samples  on  them.  We  did  this  using  a  poly-L-lysine  solution  and  glass  slides. 
Once  we  had  the  slides  prepared,  we  were  able  to  use  the  AFM  to  look  for 
bacteria.  When  using  the  AFM,  the  laser  first  has  to  be  aligned  on  the  end  of  the 
cantilever.  The  diodes  then  have  to  be  adjusted  so  that  the  laser  hits  them.  After 
that,  the  stage  that  holds  the  cantilever  is  lowered  down  close  to  the  sample.  From 
that  point,  the  tip  can  be  gradually  approached.  A  z  piezo  crystal  is  responsible  for 
moving  the  tip  closer  to  the  sample  in  small  enough  increments  that  it  will  be  able 
to  engage  with  the  surface  without  breaking  off  Once  the  tip  is  engaged,  imaging 
can  be  started.  In  general,  we  scanned  a  relatively  large  size  first  (about  40  to  60 
microns).  From  the  large  scan,  we  were  able  to  find  bacteria.  We  then  would  scan 
a  smaller  size  that  included  only  the  bacteria  piece  that  we  were  interested  in. 

When  scanning,  we  had  to  find  the  right  adjustments  for  the  rate  of  the  scan,  as 
well  as  the  height  of  the  tip.  We  also  had  to  adjust  various  other  settings  to 
guarantee  that  we  were  getting  the  best  quality  images  possible.  Once  we  were 
able  to  scan  an  area  that  definitely  contained  bacteria,  then  we  would  perform  a 
high-resolution  scan  that  would  take  up  to  20  minutes.  Although  we  didn’t  get  to 
much  analysis  of  the  images,  a  computer  program  can  be  used  to  measure  the 
bacteria  and  manipulate  the  images.  We  began  measuring  some  of  the  images 
from  the  samples. 

Results 

In  addition  to  learning  how  to  use  the  AFM,  I  was  also  able  to  obtain 
images  of  each  of  the  four  strains  of  bacteria,  which  I  will  include.  More  images 
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will  be  obtained  next  quarter,  and  more  analysis  of  the  images  will  be  done  next 
quarter  as  well. 

1063-S  ^ 

This  sample  is  about  five 
microns  long,  one  micron  wide,  and 
500  nanometers  (nm)  tall. 

QuickTime^  and  a 
TIFF  (Uncompressed)  decompressor 
are  needed  to  see  this  picture. 


QuickTime™  and  a 
TIFF  (Uncompressed)  decompressor 

are  needed  to  see  this  picture.  <-NCFM 

This  sample  is  about  three  and  a  half 
microns  long,  one  micron  wide,  and  180  nm 
tall. 


NCFM  LaCl  ^ 

This  sample  is  about  four 
microns  long,  two  microns  wide,  and 
250  nm  tall. 


QuickTime™  and  a 
TIFF  (Uncompressed)  decompressor 
are  needed  to  see  this  picture. 


QuickTime™  and  a 
TIFF  (Uncompressed)  decompressor 

are  needed  to  see  this  picture.  <-  NCFM  SlpA  KO 
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This  sample  is  about  five  microns  long,  one  micron  wide,  and  250  nm  tall. 

Conclusion 

Overall,  I  think  that  this  quarter  was  a  success.  Tm  glad  that  I  was  able  to 
become  proficient  on  the  AFM  and  at  least  begin  to  take  images.  Next  quarter  we 
will  be  able  to  make  more  generalizations  about  the  strains  of  bacteria  once  we 
have  more  images.  We  also  will  be  able  to  measure  the  adhesion  forces  once  we 
get  the  necessary  part  for  the  AFM.  Once  we  can  do  that,  we  will  be  able  to  work 
on  our  original  purpose.  I’m  very  excited  to  continue  working  next  quarter. 
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ABSTRACT 


Most  current  probabilistic  decision  making  software  programs  have  failed  to  communicate 
scenarios  effectively  with  users  who  are  not  familiar  with  statistical  theory.  This  makes  it  very 
difficult  for  users  to  benefit  from  the  information  presented  by  such  software.  In  this  project,  we 
have  continued  earlier  research  to  determine  the  best  way  to  present  information  about  a 
stochastic  plan  to  users  with  varying  backgrounds.  We  have  been  primarily  focusing  on  the  domain 
of  academic  advising  with  an  overarching  goal  that  the  specific  results  we  find  can  be  applied  to 
other  domains. 

Over  the  course  of  the  last  two  quarters,  the  team  has  progressed  through  several  successive 
phases  of  work  on  this  project.  We  began  our  project  by  identifying  the  weaknesses  of  a  previous 
system,  Plan  It.  From  that  list,  from  group  brainstorming,  and  from  some  background  research  that 
we  performed,  the  team  developed  a  list  of  goals  for  the  types  of  information  and  the  ways  in  which 
the  data  would  be  accessed.  These  goals  were  then  turned  into  prototypes  for  new  interfaces. 

This  quarter,  we  began  implementation  of  the  prototypes  and  the  needed  back-end  software.  The 
back-end  system  has  two  layers:  the  first  will  parse  (or  read)  the  actual  plan  data,  and  the  second 
will  convert  it  into  a  form  usable  by  our  API.  The  second  layer,  the  API  itself,  will  provide  different 
presentation  software  with  unified  procedures  for  accessing  and  manipulating  a  plan,  so  that  every 
presentation  is  based  off  of  the  same  critical  cognitive  elements.  The  API  has  been  completed,  and 
the  parser  is  in  development. 
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INTRODUCTION 


Human  beings  are  constantly  looking  for  advice  in  situations  where  decisions  are  complex  and 
include  a  vast  array  of  possible  choices  and  outcomes.  The  concepts  of  multi-step  planning  with 
probabilistic  outcomes  at  each  stage  are  fairly  well  known  and  researched  (at  least  among 
academics  and  statisticians].  The  planning  process  and  computations  have  been  implemented  on 
computers  in  a  many  ways,  with  reasonable  success.  However,  most  probabilistic  decision  making 
software  programs  have  failed  to  communicate  scenarios  effectively  with  users  who  are  not 
familiar  with  statistical  theory.  This  communication  gap  makes  it  difficult,  if  not  impossible,  for 
users  to  gain  any  benefit  from  the  information  presented  by  these  software  packages. 

In  this  project,  the  primary  domain  of  research  is  applying  plan  visualization  in  advising  settings. 
These  include  academic  advising  and  advising  of  "welfare  to  work  "  program  clients.  Both  problem 
sets  would  greatly  benefit  from  having  a  software  program  to  compliment  advisors  with  large  case 
loads.  While  these  subjects  are  the  main  problems  we  are  focusing  on  solving  through  this 
research,  there  is  a  broader,  secondary  goal  to  learn  about  how  humans  visualize  and  understand 
decision  making  scenarios  through  the  use  of  technology.  Eventually,  we  hope  to  publish  our 
generalized  findings  in  a  journal  on  artificial  intelligence  and  possibly  present  the  results  at  a 
related  conference. 
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THEORY  AND  BACKGROUND  INFORMATION 


This  section  introduces  the  theoretical  concepts  that  form  the  basis  for  our  work. 

PLANS 


A  plan,  most  simply,  is  a  mapping  showing  what  actions  someone  should  take  when  in  a  particular 
situation.  This  mapping,  however,  is  not  typically  the  information  given  directly  to  the  program  by 
the  user.  More  typically,  a  structure  such  as  a  Markov  Decision-making  Process(MDP)  that  includes 
notions  of  multiple  actions,  result  probabilities,  and  state  utility  will  be  given.  It  is  then  fed  through 
an  optimization  algorithm  that  computes  the  plan  from  the  given  MDP.  MDP's  are  formally 
introduced  in  the  next  section. 

Here  is  a  textual  example  ofa  simple  plan  for  a  student  picking  Mathematics  courses: 

You  got  a  C  in  Calculus  1  and  11,  and  you  want  to  take  classes  that  best  fit  your  abilities.  First,  take 
Calculus  III.  If  you  get  an  A  or  a  B,  take  Statistics.  If  you  pass  Statistics  take  Statistical  Theory, 
otherwise  retake  it.  If  you  got  a  C  in  Calculus  III,  take  Physics.  If  you  get  an  A  in  Physics  take 
Quantum  Theory,  if  you  get  a  B  take  Dynamics,  or  if  you  got  a  C  or  an  F  take  Chemistry.  If  you  failed 
Calculus  III  take  English  Composition.  If  you  pass  Composition  take  Creative  Writing,  otherwise 
take  Sculpture. 


COGNITIVE  MODELS 


The  theory  of  cognitive  models  is  critical  to  the  success  of  this  project.  Essentially,  that  theory 
states  that  any  thought  process  (such  as  exploring  our  interface)  can  be  modeled  in  a  way  common 
to  all  people  (the  cognitive  model),  such  that  finding  and  using  the  correct  model  will  make  the 
thought  process  easy  and  intuitive.  The  old  interface  of  the  Planit  software  did  not  correspond  to 
the  thought  processes  of  the  University  of  Kentucky  students  who  participated  in  the  experiment 
nor  ours.  This  disconnect  makes  the  software  difficult  to  use.  Thus,  the  goal  for  this  project  is  to 

create  and  implement  an  interface  that  more 
closely  matches  the  cognitive  model  that 
people  have  for  visualizing  and  interacting 
with  information  about  possible  actions  and 
results. 

The  basic  model  used  in  this  project  to 
represent  human  decision  making  is  the 
Markov  Decision-Making  Process 
(commonly  denoted  MDP).  The  building 
blocks  for  a  MDP  are  states  which  are  each  a 
representation  of  a  combination  of  values 
for  plan  variables.  In  academic  advising. 


Formal  Definition  of  an  MDP 

An  MDP  is  a  4-tuple  (5,  A,  P,  R)  where: 

•  5  is  a  set  of  states 

•  A  is  a  set  of  actions 

•  P:  Ax  S  X  S  -*  [0,1]  is  a  function  where 
P(a,  s,  s')  is  the  probability  that  if  action  a  is 
taken  whilst  in  state  s,  the  result  will  be  s' 

•  R\S  X  S  M  where  P (s, s')  is  the  utility  of 
transitioning  from  s  to  s'  with  M  an  ordered 
set  such  that  transitioning  from  s  to  s'  is  said 
to  have  more  utility  than  transitioning  from  t 
to  t'  if  and  only  if  P(s,s')  >  P(t,  t'). 
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these  variables  could  include  classes  taken  and  grades  received  in  each  course.  Each  state  has  a 
numerical  quantity  associated  with  it  called  the  utility.  This  value  represents  the  relative  benefit  of 
being  in  this  state  in  terms  of  its  contribution  to  the  desired  final  outcome.  From  each  state,  there 
are  different  actions  that  can  be  taken,  each  with  results  of  varying  probability.  These  results  are 
actually  each  just  the  state  that  is  reached  by  taking  the  given  action  and  achieving  the  given  result. 

COMPLEXITY 


The  diagram  shown  at  the  right  is  a  graphical  representation  of  a 
simple  stochastic  plan  in  the  academic  advising  domain.  It  is 
important  to  note  that  this  diagram  only  shows  the  suggested 
action  to  take  when  in  each  state  and  does  not  show  alternative 
actions  and  the  probabilities  of  the  results  of  the  actions.  These 
probabilities  and  additional  actions  are  all  information  that  needs 
to  be  displayed  to  a  user  of  this  software  but  are  not  part  of  the 
formal  definition  of  a  plan.  The  example  can  also  be  a  little 
misleading  since  it  seems  to  suggest  that  navigating  a  plan  is 
simply  a  matter  of  progressing  or  not  progressing.  A  more 
realistic,  but  more  complex,  example  may  suggest  different 
classes  to  take  based  on  previous  grades  and  coursework  rather 
than  just  advise  to  or  not  to  move  on.  A  more  realistic  plan  would  also  likely  dictate  several  classes 
to  take  and  have  the  result  transitions  for  each  possible  combination  of  course  grades. 

Even  in  this  very  simplified  example  of  a  plan,  which  has  few  actions  and  few  states,  it  is  difficult  to 
discern  useful  information.  Now  consider  the  amount  of  states  and  actions  needed  to  represent  all 
of  the  different  possible  combinations  of  coursework  and  grades  that  a  student  could  take  in  their 
college  career.  In  addition,  consider  how  many  possibilities  there  are  for  student  goals  and 
preferences.  You  can  easily  see  how  these  scenarios  quickly  grow  into  exponentially  large  problem 
sets  and  are  very  difficult  to  display  without  some  novel  thinking. 

PREVIOUS  WORK 
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This  project  is  a  continuation  of  efforts  made  by  a  group  of 
students  and  Professors  from  the  University  of  Kentucky.  Their 
efforts  led  to  the  development  of  a  software  suite  called  Planlt. 
This  software's  function  is  to  interact  with  the  user  to  show  them 
how  various  actions  will  likely  affect  the  outcome  of  some  process.  It  has  been  written  so  that  the 
decision  making  algorithm  can  be  switched  in  and  out.  This  allows  independent  development  of  the 
prediction  logic  and  the  interface  presented  to  the  user.  The  current  user  interface  was  tested 
using  freshman  computer  science  students  at  the  University  of  Kentucky.  The  overwhelming 
response  was  that  it  did  not  provide  an  intuitive  experience.  Thus,  our  research  involves 
developing  a  new  interface  for  interacting  with  users. 
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METHODS/EXPERIMENTATION 


Since  there  is  no  known  cognitive  model  for  our  problem  domain,  we  can  only  analyze  the  model 
indirectly  by  examining  the  response  of  ourselves  and  others  to  interfaces  built  on  a  specific  model. 
The  first  stage  of  the  project  was  to  use  the  old  interface,  and  find  all  the  parts  we  didn’t  like,  or  that 
were  difficult  to  use.  In  theory,  these  parts  did  not  sufficiently  match  the  cognitive  model  for 
stochastic  planning,  and  so  should  be  changed.  The  next  stage  was  to,  again  using  the  old  interface, 
make  a  list  of  features  we'd  like  to  see  in  a  new  interface.  Hopefully,  these  features  are  essential, 
intuitive  parts  of  the  cognitive  model.  Next,  we  used  our  research  materials  to  reinforce  our 
knowledge  of  cognition.  We  distilled  our  problems  and  features  into  essential  facts  about  the 
underlying  cognitive  model,  and  brainstormed  ways  to  make  a  new  interface  that  closely  matched 
the  model.  To  conclude  the  previous  quarter  s  work,  we  designed  prototype  interfaces  that  use  our 
discovered  model. 

To  build  our  API  for  this  quarter,  we  first  considered  the  data  in  a  plan  and  ordered  it  according  to 
our  cognitive  model.  Using  Java’s  object-oriented  approach,  we  wrote  software  that  would  store 
data  according  to  our  desired  organization.  Next,  we  collaboratively  brainstormed  different  ways 
that  interfaces  would  need  to  work  with  the  data  in  a  plan.  Following  good  design  principles,  we 
extended  our  software  to  include  these  methods,  or  operations,  as  well  as  the  data.  We  are 
currently  working  on  two  fronts:  building  a  sample  plan  to  test  our  API  and  begin  using  it  with 
interfaces  as  well  as  building  a  parser  to  read  data  from  the  planner  and  distill  it  for  use  in  the  API. 

RESULTS 


In  this  section  we  present  the  results  from  all  of  the  stages  of  our  research  performed  thus  far. 

PROBLEMS  WITH  THE  CURRENT  SYSTEM 


We  have  summarized  our  research  regarding  the 
problems  with  the  current  system  in  this  list: 

•  Currently  does  not  distinguish  between 
recoverable  and  unrecoverable  bad  states 
in  color. 

•  The  terminology/vocabulary  is  confusing. 

•  The  system  does  not  do  anything  at  a 
dead  end  state.  For  instance,  in  the  robot 
example,  once  the  user  has  coffee  there  is 
1  state  with  100%  probability  that  will 
keep  coming  up  no  matter  how  many 
times  you  press  forward. 

•  Information  about  current/future  states 
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is  hard  to  visualize. 

•  Changes  between  states  are  hard  to  evaluate. 

•  The  current  software  does  not  allow  comparison  of  multiple  actions  and/or  results.  See  one 
result  state  at  a  time. 

•  Need  more  granularity  for  display  of  utility  and  probability. 

•  The  choice  of  action  seems  to  be  subordinate  to  the  result  rather  than  the  other  way  around. 
Also,  action  selection  is  hard  to  use  and  understand. 

•  It  is  hard  (i.e.  impossible  without  many  clicks)  to  see  the  long  term  result  of  choosing  a 
specific  action. 

•  No  way  to  go  back  large  distances,  (i.e.  beginning,  specific  points). 

•  The  system  is  currently  missing  why  a  state  changed  the  way  it  did. 

•  There  is  no  indication  of  time  progression. 

GOALS  FOR  THE  NEW  SYSTEM 


The  following  are  the  goals  we  developed  for  the  new  system: 


The  Big  Picture 

o  actions  displayed  more  prominently  than  results,  should  show  sub  ordinance 
o  Glossary  -  'Tooltips'  to  explain  vague/difficult  terminology 
o  Customizing  and  saving  the  following: 

■  Ability  to  customize  how  some  components  work 

■  Ability  to  move  information  and  components  around  into  an  organization 
that  best  suits  the  user. 

■  Domain  specific  default  views  and  view  components 
o  Progress  indication 

o  Somehow  quantify  number  of  possible  paths  to  indicate  flexibility  in  plan. 

States 

o  include  information  about  time  (not  in  model  classes,  but  in  user  view) 
o  save/load  states  (ie  checkpoints) 
o  indicate  most  desirable  action 

Actions 

o  indicate  most  probable  result 

Results 

o  the  reason  for  the  result:  what  actually  happened  to  cause  the  state  to  change  the 
way  it  did 

o  the  utility  of  the  result  state 
o  the  distance  from  that  state  to  the  goal  state(s) 
o  state  changes:  full  state  is  accessible  but  not  shown  by  default 
o  indicate  most  probable  final  outcome 
Preferences 

o  determine  weighting,  or  utility,  of  state  variables 
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o  choose  between  multiple  goal  states 

•  Goals 

o  determine  ’ending'  states 
o  must  be  met 

•  Evaluation  of  Multiple  Sequential  Actions/Results 

NEW  SYSTEM  INTERFACES 


The  research  team  developed  the  following  three  prototypes: 


TRADITIONAL  DESIGN 


This  specification  of  a  new  U1  for  Planlt  has  been  written  with  many  specifics  for  the  academic 
advising  domain.  Much  of  this  can  be  generalized  to  other  planning  domains.  In  contrast  to  the 
other  two  designs  shown,  this  is  the  only  one  to  currently  be  in  the  implementation  phase. 

PAST 

The  past  section  shows  aggregate  data  regarding  previous  states.  In  academic  advising,  this  would 
consist  of  milestones  completed,  gpa,  quarters  completed,  etc.  This  section  will  have  a  button  to 
show  more  detailed  information  about  the  previous  states  such  as  specific  classes  taken  and 
specific  grades. 


PRESENT 

The  present  section  is  the  most  interactive  of  the  sections  and  is  where  the  choice  of  actions  and 
outcomes  takes  place.  For  academic  advising,  there  is  a  box  of  labeled  check  boxes  that  represents 
each  class  that  the  student  could  take  in  that  term.  Below  that  list  is  a  tabbed  panel  that  shows  a  tab 
for  each  course.  On  that  tab,  the  user  can  see  the  most  likely  outcome  for  that  class  and  choose 
which  outcome  they  would  like  the  plan  to  use.  On  any  change  in  checkboxes  or  choice  of  outcome, 
the  UI  immediately  updates  to  show  the  effect  of  that  change. 

FUTURE 

The  future  section  shows  aggregate  information  about  the  likely  future  based  on  the  choice  of 
actions  and  outcomes  in  the  present  section.  As  with  the  past  section,  there  will  be  a  button  to  show 
detailed  information  about  the  projected  future. 

FILMSTRIP 

The  filmstrip  helps  to  give  a  visual  reference  to  the  concept  of  time.  In  the  academic  advising 
domain,  this  would  show  a  summary  of  the  term.  This  would  also  allow  the  user  to  quickly  change 
the  choices  at  a  given  term  and  see  the  cascading  effect  of  this  change. 
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SCREENSHOT 


Here  is  a  recent  screenshot  of  this  U1  concept: 
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ALTERNATING  ABCTIONS  AND  RESULTS  "EXPLODING"  DESIGN 

This  design  differentiates  between  actions  and  results  by  having  the  user  select  an  action,  bringing 
up  a  screen  where  they  select  a  result,  which  then  becomes  the  current  state  and  allows  new  action 
choices.  This  design  remains  in  the  prototype  stage. 

CHOOSING  AN  ACTION 


This  view  allows  the  user  to  select  between  available 
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CHOOSING  A  RESULT 


This  view  allows  the  user  to  choose  between  results  for 
a  specific  action. 
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Current  state,  as  with  the  action  selection  view,  is  shown  at  the  bottom.  By  default,  results  show 
only  their  short  description,  consisting  of  probability,  utility,  and  state  changes,  but  complete  state 
information  can  be  accessed.  Choosing  a  result  causes  its  state  changes  to  take  effect  (its  state 
replaces  the  current  state),  and  the  user  is  shown  a  new  Choosing  an  Action  screen. 


HEAVILY  VISUAL  "TIME  MACHINE"  DESIGN 


This  prototype  design  and  write-up  is  by  Kyle  Cushing  a  member  of  the  research  team  working  on 
his  senior  project.  All  of  the  prototypes  were  discussed  together  and  while  each  was  written  by  an 
individual  group  member,  are  a  result  of  group  discussion. 

The  purpose  of  the  Time  Machine  model  is  to  be  able  to  view  a  large  portion  of  the  policy  tree 
compared  to  other  version.  The  base  design  is  from  the  website  widget  on  Etsy  to  view  past 
orders/items  for  sale.  This  design  is  also  still  in  the  prototype  stage. 

STANDARD  VIEW 

This  is  the  standard  view  with  no  actions  currently  selected: 
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GRAPHICAL  REPRESENTATION  OF  INFORMATION 

The  values  of  Quality  and  probability  are  represented  graphically  in  this  model  by:  Line  Thickness 
and  Window  Coloring.  Probability  -  Represented  by  the  Thickness  of  the  lines  that  connect  the 
various  states.  Quality  -  Represented  by  a  color  scale  from  red  to  blue  (Red  -  worst  quality,  Blue  - 
best  quality)  of  the  future  states. 

The  lines  are  either  solid  or  dashed  to  show  which  result  states  are  possible  by  choosing  the 
Suggested  Action.  Solid  lines  connect  the  current  state  to  result  state(s)  by  means  of  the  Suggested 
Action.  The  dashed  lines  connect  the  current  stated  to  result  state(s)  by  means  of  Alternate  Actions. 
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ACTIONS  SELECTED 

This  is  the  view  once  an  action  has  been  selected: 


After  an  action  is  selected  the  result  states  not  associated  with  that  particular  action  are  hidden 
below  view,  but  the  lines  to  them  are  still  visible.  In  the  above  example  the  suggested  action's  was 
chosen  and  thus  the  result  states  associated  with  the  Suggested  Action  remain  in  the  main  view. 

MOUSE  OVER  RESULT  STATES 

This  is  the  view  when  the  user  moves  their  mouse  over  any  one  of  the  possible  future  result  states. 
The  change  between  the  current  state  and  the  result  state  that  they  have  placed  their  mouse  over 
are  displayed  in  a  tool-tip  like  window  near  the  mouse  cursor. 


I 
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THE  APPLICATION  PROGRAMMING  INTERFACE  (API) 

In  order  to  allow  different  interfaces  to  be  quickly  developed  over  a  common  set  of  data,  we 
carefully  wrote  an  Application  Programming  Interface  for  plan  data.  An  Application  Programming 
Interface  (usually  called  API  for  short),  is  a  set  of  functions  that  allow  an  outside  program  access  to 
get  and  manipulate  data  in  some  data  structure.  As  mentioned  before,  in  our  program,  the  API  is 
used  to  abstract  away  the  details  of  navigating  through  a  plan  and  keeping  track  of  its  data  into  a 
common  interface  that  can  be  put  underneath  any  of  the  user  interfaces  that  we  develop.  This  will 
also  allow  us  to  optimize  our  code  more  quickly  since  the  interface  is  shared  rather  than  written 
specifically  for  each  user  interface. 


DESIGN/GOALS 


When  going  through  the  process  of  defining  our  interface,  we  considered  several  goals  for  our 
design.  The  first  of  the  more  important  goals  is  ensuring  that  the  design  provides  simple, 
unobtrusive  access  to  the  data  by  the  APIs.  To  achieve  this  goal,  we  considered  the  types  of  data 
that  most  interfaces  will  require,  the  order  in  which  they  will  need  the  data,  and  the  likely  patterns 
in  which  they  use  the  data.  The  second  of  these  goals  is  to  have  the  data  be  represented  as  naturally 
as  possible.  A  natural  representation  gives  the  best  chance  that  the  API’s  design  will  match  up 
closely  with  the  ways  in  which  interfaces  are  using  the  information.  Finally,  we  prioritized  making 
the  API  as  generic  as  possible.  That  is,  we  tried  to  abstract  away  all  details  that  are  specific  to  a 
certain  domain.  This  will  allow  the  API  to  be  used  for  any  number  of  unique  domains. 

Below  you  can  see  a  Uniform  Modeling  Language  (often  abbreviated  UML)  diagram  showing  our 
design  for  the  API.  This  diagram  represents  the  knowledge  that  a  designer  of  a  user  interface 
would  need  in  order  to  build  an  interface  over  the  API.  It  does  not  include  the  implementation- 
specific  details  that  the  API  designer  must  consider  in  order  to  make  the  API  operate  correctly  and 
efficiently.  This  style  of  abstraction  and  hiding  implementation  details  by  simply  providing  a  public 
interface  to  a  data  set  is  called  black  box. 
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IMPLEMENTATION 

We  wrote  the  API  in  Java,  following  proper  software  design  principles.  For  the  data  portion  we 
mostly  wrote  our  own  classes,  while  the  methods  made  use  of  some  built-in  Java  classes  as  well. 
These  classes  have  been  widely  used  and  tested,  so  we  can  be  reasonably  certain  that  any  problems 
would  be  in  our  code.  As  much  as  possible,  we  implemented  our  code  to  be  modifiable,  so  that  we 
could  change  the  particular  way  we  accomplish  something  without  changing  what  actually  gets 
accomplished.  We  also  ensured  that  the  code  was  general  enough  to  accommodate  diverse 
problem  domains,  and  that  we  could  easily  change  the  code  to  fit  even  more  diverse  situations. 

THE  PARSER 

As  was  demonstrated  in  the  "Theory  and  Background  Information"  section  of  this  paper,  a  plan  is 
an  extremely  complex  network  of  states  and  actions.  Since  in  our  design  there  are  separate 
modules  to  compute  and  display  plans.  Since  the  planner  we  are  using  is  not  specific  to  our 
program,  its  output  is  not  in  a  form  readily  usable  by  our  user  interfaces  through  the  API.  To  bridge 
this  gap,  we  must  implement  a  parser.  This  component  will  carefully  read  through  the  output  of  the 
planner  and  convert  the  plan  information  into  the  data  structures  accessible  via  the  API.  For  this 
quarter’s  work,  the  team  got  familiar  with  the  output  of  the  planner  module  in  order  to  determine 
how  to  best  write  the  parser. 
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CONCLUSIONS 


Following  last  quarter's  analysis  of  the  old  interface  and  planning  cognition,  we  have  implemented 
an  API  containing  elements  of  the  cognitive  model  that  should  be  common  to  all  effective  plan 
interfaces.  Efforts  are  underway  both  to  develop  interfaces  to  use  this  API,  and  to  translate  plan 
information  into  an  API-accessible  form.  Next  quarter  should  see  these  efforts  to  completion,  and 
scientific  experimentation  to  evaluate  our  work  will  commence  the  following  quarter. 

FUTURE  WORK 


Having  completed  the  majority  of  the  higher-level  planning  and  design  phases  of  the  project,  the 
team  will  proceed  with  implementation,  testing,  and  experimentation.  First,  the  group  will 
complete  the  implementation  of  the  plan  parser  and  three  interface  designs.  These  will  all  then  be 
comprehensively  tested  for  correctness.  Once  the  team  is  confident  that  the  implementations  are 
thorough  and  correct,  we  will  devise  our  experiments  and  get  the  necessary  permissions  from  the 
institutional  review  board.  Using  volunteer  students  from  the  department  as  test  subjects,  we  will 
run  our  experiments  and  collect  the  results.  Since  the  data  will  be  mostly  subjective  in  nature,  our 
next  task  will  be  to  sort  through  the  results  and  understand  the  meaning.  We  hope  to  use  this  to 
improve  our  interfaces  and  possibly  develop  new  ones  that  emphasize  the  features  requested  by 
the  test  users. 

The  team  will  mostly  halt  work  during  the  Summer  Term  due  to  internships,  time  off,  and  summer 
vacation  plans.  The  research  will  continue  again  as  an  honors  research  project  during  Fall  Quarter. 
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APPENDIX  A  -  THE  WIKI 


Please  see  our  project  wiki  at  http://wiki.csc.calpoly.edu/planit.  On  that  site  we  have  a  complete 
view  of  the  research  performed  thus  far  as  well  as  updated  information  about  the  current  status  of 
the  project. 
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IMPLEMENTATION  OF  ARTIFICIAL  NEURAL  NETWORK  FOR  CONTROL  OF  SIMULATED 

WHEELED  ROBOT 

Alan  Tepe 
Dr.  Xiao-Hua  Yu 


iNTRODUCTION 

Artificial  neural  networks  (ANNs)  arc  functions  whose  structure  is  based  on  biological  neural  networks  found  in  living 
organisms.  They  consist  of  a  number  of  simple  functions  (nodes),  whose  outputs  and  inputs  arc  linked  by  weighted  connections. 
By  adjusting  the  connection  weights  between  nodes,  it  is  possible  to  generate  a  number  of  interesting  behaviors  in  a  neural 
network,  including  the  modeling  and  control  of  systems  (Meltser,  1996). 

The  most  exciting  property  artificial  neural  networks  is  their  ability  to  ‘Mcam”.  Given  a  set  of  input  data  and  desired  output,  it  is 
possible  to  optimize  the  weighted  connections  within  a  neural  network  so  that  the  network  produces  the  desired  output  with 
input.  Artificial  neural  networks  can  serve  as  universal  appropriators.  It  has  been  shown  that  a  neural  network  of  sufficient  size 
can  approximate  any  non  linear  function  (Narcndra,  1990). 

Artificial  neural  networks  have  been  successfully  used  in  a  number  of  robotics  applications,  including  path  planning  (Glasius, 
1993),  controls  (Narendra,  1990),  and  decision  making  (Bekcy,  2005). 

This  paper  presents  the  results  of  a  simple  neural  network  experiment.  A  neural  network  was  created  and  trained  to  control  a 
simulated  driving  robot.  Utilizing  the  neural  network,  the  robot  was  trained  to  drive  along  a  straight  line  path  and  return  to  the 
path  if  it  strayed. 

ROBOT  SIMULATOR 

A  simple  computer  model  of  a  two  wheeled  robot  was  created  using  basic  concepts  from  dynamics.  This  computer  model  was 
programmed  in  MATLAB.  The  computer  model  took  robot  motor  torques  as  an  input  and  calculated  the  path  of  the  robot  over 
time  as  an  output.  This  computer  model  used  several  assumptions  to  simplify  computations.  These  arc  detailed  below.  More 
details  on  the  robot  model  can  be  found  in  the  appendices  of  this  paper. 


Figure  I:  Illustration  showing  dynamics  calculations  behind  modeled  robot.  The  model  used  simple 
dynamics  to  calculate  robot  position  over  time  w  ith  motor  torques  as  an  input 
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Robot  Model  Assumptions 

•  No  slip  condition  between  ground  and  robot  wheels 

o  It  was  assumed  that  the  force  of  friction  between  the  ground  and  the  wheels  of  the  robot  was  sufficient  to  prevent 
any  slipping  of  the  tires,  this  assumption  seemed  warranted  because  the  weight  of  the  robot  was  large  when 
compared  to  the  range  of  torques  applied  to  the  wheels. 

•  Even  distribution  of  weight  between  robot  wheels 

o  It  was  assumed  that  each  of  the  two  wheels  on  the  robot  carried  an  equal  portion  of  the  robot  weight,  despite  the 
motion  the  robot  might  be  undergoing.  This  assumption  seemed  valid  because  the  turning  velocities  of  the  robot 
were  relatively  low  compared  to  those  that  would  cause  a  large  difference  in  weight  distribution. 

•  Robot  able  to  accurately  determine  some  information  about  its  position  and  orientation 

o  It  was  assumed  that  the  robot  could  determine  how  far  away  it  was  from  its  desired  path,  and  that  the  robot  could 
determine  which  direction  it  was  facing  relative  to  the  direction  of  its  desired  path.  This  assumptions  seemed  valid, 
as  measurement  equipment  could  be  designed  for  a  physical  robot  to  make  these  measurements. 

Robot  Environment 

a  simple  environment  was  modeled  to  contain  the  robot  model  detailed  above.  The  environment  consisted  of  a  uniform  flat  plate 
with  surrounding  walls,  the  simulated  walls  would  stop  operation  of  the  robot  model  if  the  robot  hit  them.  The  simulated 
environment  also  contained  a  straight  line  drawn  from  one  comer  to  the  other,  to  serve  as  a  desired  path  for  the  robot  to  follow. 
An  above  view  of  this  environment  can  be  seen  in  figure  2. 


Modtifed  Robot  Envltonnwit 


Figure  2:  Modeled  environment  for  robot.  The  blue  lines  are  walls  that  halt  the 
operation  of  the  robot  if  hit,  and  the  green  line  is  a  pathline  that  the  robot  is  meant 
to  follow.  Dimensions  shown  are  in  meters 


Desired  Robot  Behavior 

For  this  experiment,  it  was  desired  that  the  robot  follow  a  specific  path  in  the  above  environment.  To  train  the  neural  network  to 
follow  this  path,  it  was  necessary  to  define  a  desired  output  for  the  neural  network  for  every  possible  input.  This  was  because  we 
used  the  back  propagation  training  algorithm  to  optimize  neural  network  weights,  which  requires  a  set  of  training  data 
(consisting  of  inputs  and  desired  outputs)  (Reed  &  Marks,  1999).  To  create  this  training  data,  we  made  a  simple  function  that 
calculated  desired  left  and  right  motor  torques  for  a  given  position  and  orientation  of  the  robot.  This  function  kept  the  robot 
within  a  small  distance  of  the  desired  path  for  the  duration  of  its  motion,  and  created  the  robot  behavior  we  desired  to  replicate 
with  neural  network  control.  The  behavior  of  the  robot  with  motor  torques  created  by  the  training  data  function  can  be  seen  in 
figure  3. 

%add  picture  with  desired  neural  network  inputs  and  outputs 
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Desired  Robot  Path 
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Figure  3:  Behavior  of  robot  when  training  data  function  was  used  to  control  robot  motor 
torques.  This  is  the  desired  behavior  of  the  robot:  the  robot  corrects  itself  when  it  gets  off  the 
desired  path. 


NEURAL  NETWORK 

A  relatively  simple  artifieial  neural  network  was  designed  to  eontrol  motor  torques  of  the  robot.  It  eonsisted  of  two  input  nodes, 
three  hidden  nodes,  and  two  output  nodes.  The  input  nodes  took  in  the  distanee  between  the  desired  path  and  the  robot  position, 
and  the  differenee  in  angle  (radians)  between  the  robot  orientation  and  the  path  direetion.  The  artifieial  neural  network  was  meant 
to  proeess  these  inputs  and  output  the  left  and  right  motor  torques  required  to  get  the  robot  baek  on  traek.  This  simple  strueture 
for  the  artifieial  neural  network  was  ehosen  beeause  it  was  hypothesized  that  the  relationship  between  neural  network  inputs  and 
outputs  was  relatively  simple,  and  might  even  be  elose  to  a  linear  relationship. 

Nodes  in  the  artificial  neural  network  used  a  hyperbolie  tangent  (tanh)  fiinetion  to  proeess  individual  inputs  and  outputs.  All 
nodes  exeept  for  the  two  output  nodes  used  the  tanh  function  for  processing.  This  is  illustrated  in  figure  4. 


558 


NOOO 14-07- 1-1 152 


P. I. Susan  C.  Opava,  Ph.D. 


Pjrfwct  T% 

ftTH  (4^ 


T« 


Figure  4:  Illustration  showing  artificial  neural  netw  ork  used  to  control  the  simulated  robot.  This  figure  also  illustrates  and  explains  the 
tw^o  inputs  to  the  network:  distance  to  path  and  angle  to  path,  as  well  as  the  tanh  function  used  in  some  of  the  network  nodes. 


Neural  Network  Connection  Weight  Optimization 

An  artificial  neural  network  can  be  used  to  approximate  any  function  (Narendra,  1990).  However,  the  connection  weights 
between  nodes  in  an  artificial  neural  network  must  be  adjusted  to  produce  desired  behaviors.  This  adjustment  amounts  to  an 
optimization  problem,  in  which  the  set  of  weights  which  produces  the  smallest  error  is  determined.  In  this  experiment,  we  used 
a  back  propagation  algorithm  to  find  the  best  connection  weights.  That  is,  the  connection  weight  which  produced  the  smallest 
difference  between  neural  network  motor  torque  output  and  desired  motor  torque  output. 

To  find  these  connection  weights,  a  technique  know  as  back  propagation  was  utilized.  This  algorithm  is  similar  to  a  gradient 
descent  algorithm,  in  that  it  calculates  derivatives  of  each  connection  weight  with  respect  to  error,  and  uses  these  derivatives  to 
connection  weights.  This  is  the  optimization  technique  used  most  often  for  training  neural  networks  (  Reed  &  Marks,  1999)  This 
algorithm  is  explained  in  more  detail  in  the  appendices. 

In  this  experiment,  the  connection  weights  were  randomly  initiated,  with  a  normal  distribution  having  a  mean  of  0.0,  and  a 
standard  distribution  of  1 .0.  The  neural  network  connection  weights  were  adjusted  with  back  propagation  with  a  set  of  training 
data.  The  training  data  consisted  of  the  inputs:  distance  to  path  and  angle  to  path  ranged,  respectively  from  -1 .0  to  1.0  meters 
and  0  to  211  radians.  As  well  as  the  desired  outputs  corresponding  to  these  inputs. 

There  were  some  difficulties  finding  optimum  connection  weights  for  the  neural  network.  It  was  difficult  to  get  the  back 
propagation  algorithm  to  converge  to  the  same  set  of  optimal  connection  weights  in  any  two  runs.  In  addition,  the  optimum 
connection  weights  produced  by  the  algorithm  weren't  able  to  follow  the  line  satisfactorily.  This  could  indicate  that  the  size  and 
geometry  of  the  neural  network  was  not  correct  for  the  line  following  application.  More  neural  networks  with  different  sizes  and 
geometries  should  be  tested  to  determine  if  this  is  the  case.  Figure  5  shows  the  paths  of  robots  controlled  by  neural  networks  with 
different  connection  weights,  as  well  as  the  neural  network  input-output  relationship.  Each  of  the  connection  weight  sets  was 
optimized  by  the  back  prorogation  algorithm.  The  figure  clearly  shows  the  large  variance  in  the  behavior  of  the  neural  networks 
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optimized  by  the  algorithm. 
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Figure  5:  Neural  network  behavior  with  various  optimized  connection  weights.  The  plots  on  the  left 
show  the  path  of  the  robot,  and  the  plots  on  the  right  show  the  input-output  behavior  of  the  artificial 
neural  network  for  the  duration  of  the  robot  motion.  The  ability  of  the  robot  to  follow  the  line  varies 
with  different  connection  weights.  We  were  unable  to  get  the  optimization  algorithm  to  consistently 
converge  to  a  set  of  connection  weights  which  keep  the  robot  on  the  desired  path. 
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CONCLUSIONS 

It  was  shown  that  adjusting  the  connection  weights  within  the  artificial  neural  network  improved  the  performance  of  the  robot 
controlled  by  the  neural  network,  however,  we  were  unable  to  fiilly  optimize  the  connection  weights  to  the  desired  solution. 
Some  troubleshooting  and  adjustment  work  must  be  completed  before  the  artificial  neural  network  can  satisfactorily  control  the 
robot  model.  Work  is  continuing  in  this  area,  and  progress  should  be  reported  before  September  of  2008. 
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APPENDIX-A  -Successful  implementations  of  artifieial  neural  networks  in  robotics  (not  eomprehensive)- 


PROJECT  NAME,  RESEARCHERS  YEAR 

SUMMARY  OF  WORK  COMPLETED 

Belgrade- use  hand  Liu,  Bekey,  beral  1989 

ANN  w  as  trained  to  choose  an  appropriate  method  of  grasping  different  sizes  of 
cylinder.  ANN  used  had  2  input  rxxles.  or>e  hidden  layer  of  4  rxxles.  and  one  output 
layer  of  2  nodes.  TTie  network  converged  to  grasping  methods  that  matched  human 
choices  after  4.595  iterations. 

Modeling  of  Robot  Dynames  by  NN  with  dynanic  neurons.  A  G 

CJiassiakos.  EB  Kosmatopoulous,  and  M  A  Chr’istodoulou 

ANN  used  to  model  dynamics  of  robotic  system  Weights  ac^usted  w  ith  back 
propagation. 

A  C>/V\C  NN  for  control  of  walking  machine.  Yi  Lin  and  Shin-Mn 

Song 

ANN  w  as  used  in  CMAC  (cerebellar  model  articulation  controller)  to  control 
movements  of  a  simulated  four  legged  walking  machir>e  in  straight  lir>e  motion.  A 
feedforw  ard  ANN  w  as  used,  w  ith  feedback  enployed  to  optirrize  connection 
weights. 

A  neural  network  based  inverse  kinematics  solution  in  robotics 

Yaotong  Li  and  Nan  Zeng 

Mjitilayer  hopfield  feedforw  ard  ANN  w  as  trained  w  ith  back  propagation  to  soNe  the 
inverse  kinematics  problem  for  a  sinulated  4  DOF  robot.  The  ANN  converged  to  a 
solution  and  was  able  to  accurately  control  the  arm  position, 

a  one-eyed  self  learning  robot  manipulator  1 991 

ANN  w  as  trained  to  control  movement  of  a  simulated  6  DOF  robot  arm  3  layer  ANN 
was  used:  7  node  input  layer,  15  node  hidden  layer,  and  2  rxxje  output  layer.  ANN 
used  w  as  feedforw  ard,  but  operated  in  a  feedback  control  loop.  Used  a  method 
similar  to  back-propagation  for  w  eight  optimization.  The  ANN  controlled  arm  was  able 
to  move  w  ithin  5mm  of  target  cons  is  ten  ty. 

Cieneralism  and  extension  of  motor  progams  for  a  sequential 
recurrent  network 

A  recurrent  Jordan  ANN  is  trained  to  control  moverrBnt  of  a  simulated  robotic  arm 
Controller  dynamics  w  ere  analyzed  w  ith  a  nurrPer  of  AMsI  designs  With  variation  in 
the  number  of  input,  hidden,  and  output  nodes 

Fast  sensormrotor  skill  acquisition  based  on  rule-based  training  of  ^gg^ 
neural  networks.  David  Handelman,  Stephen  Lane 

ANN  w  as  used  in  CMAC  to  control  simulated  movement  of  a  pole  balanced  on  a  cart. 
Desired  output  w  as  calculated  w  ith  rule  based  algorithm  this  output  w  as  w  as  used 
to  train  ANN  utilizing  back  propagation  Hybrid  controller  of  rule  based  algorithm  and 
ANN  w  as  able  to  accurately  control  cart-pole  movement. 

Senses,  skills,  reactions  and  reflexes:  learning  automatic 

behaviors  in  nutti-sensory  robotic  systems.  Jack  Gelfand,  1991 

^/brshall  Flax,  Raymond  Bndres.  Stephen  Lane,  David  Handelman 

ANN  used  in  Ck/WCto  control  simulated  robotic  arms  in  a  variety  of  tasks  with  visual 
input,  including  dribbling  a  basketball,  grabbing  an  object,  and  avoiding  an  obstacle 
during  movement. 

Learning  to  understand  and  control  in  a  w  orld  of  events  Richard  ^gg^ 

Osey 

Created  an  ANN  that  used  delayed  differential  hebian  learning  w  ith  simulated  short 
arxl  tong  term  memory  to  recognize  and  react  to  patterns. 

Developmental  robotics;  a  new  approach  to  the  specification  of  ^gg^ 

robot  programs.  Andrew  Fagg 

Trair>ed  an  ANN  to  correctly  select  sirrple  movement  actions  based  on  stimulus.  Used 
a  feedforward  ANN  w  ith  reinforcement  learning.  Utilized  the  leaky  integrator  model  of 
the  neuron.  ANN  w  as  able  to  replicate  results  obtair>ed  by  training  monkeys  to  do  the 
same  task. 

Self  selection  of  input  stimuli  for  inproving  performance,  .^gg^ 

S:ephano  Nolfi,  Domenico  Ririsi 

Created  feedorw  ard  ANN  that  w  as  trained  to  navigate  tow  ard  targets  on  a  simulated 
2D  surface.  The  ANN  was  trained  with  a  genetic  a IgorithmfrarKlom  weight  initiation, 
best  fitted  of  each  generation  create  r>ext  generation...)  research  showed  that  ANN 
trained  w  ith  genetic  algorithm  can  optimize  performance  in  tw  o  w  ays:  learning  to  act 
on  any  stimulus  it  receives,  or  only  acting  on  a  self-selected  sub  class  of  stimuli. 
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PROJECT  NAME.  RESEARCHERS  YEAR 

SUMMARY  OF  WORK  COMPLETED 

Dynamic  balance  of  a  biped  walking  robot.  Thomas  Mtler  III, 

Andrew  Kun 

Used  3  CMKC  ANNs  to  train  a  biped  robot  to  w  alk  and  balance  (robot  had  10 
actuators,  10  motor  position  sensors,  8  foot  force  sensors,  2  body  accelerometers). 
Used  a  totally  of  3  ANN:  foot  contact,  front  to  back  balance  &  left  to  right  balance. 
Feedforward  ANNs  used,  with  feedback  error  learning.  ANNs  modulated  gaits 
produced  by  a  central  gait  generator. ANNs  implemented  in  hardware  (35.7  Hz 
update).  Following  an  hour  of  training  the  robot  showed  m^r  irTprovement  in 
walking. 

Visual  feedback  in  motion.  Patrick  van  der  Smagt.  Frans  Groen  1997 

ANN  trained  to  control  a  3  DOF  robotic  arm  (simulated  OSCAR  robot)  w  ith  desired 
manipulator  path  as  an  input.  ANN  trained  w  ith  back  propagation.  After  a  few  trials 
arm  w  as  able  to  consistently  get  w  ithin  50mm  of  desired  target  in  the  desired  time. 

The  neural  dynamics  approach  to  sensory- motor  control.  F^olo 

Gaudiano,  Frank  Guenther,  Eduardo  Zalama 

ANNs  trained  to  control  sinxilated  robotic  arm,  sinrulated  w  heeled  robot.  ANN 
structure  based  on  the  VAN  (vector  associative  map)  and  VFTE  (vector  integration  to 
end  point)  control  nrxxJels. 

Neural  Vehicles.  Ben  Krbse.  Joris  Van  Dam  1997 

ANN  use  in  autonorrous  navigation  is  investigated.  ANN  was  trained  to  control  a  car 
with  images  of  the  road  ahead  as  input,  feedforward  ANN  was  used,  trained  with 
back  propagation,  w  ith  human  driving  actions  used  to  calculate  error.  ANN  w  as  able 
to  control  vehicle  at  tw  ice  the  speed  of  non-neural  controler.  navigation  ANNs  w  ere 
also  trained  w  ith  adaptive  hueristic  critic  (AHC)  and  Q-learning.  ANN  were  also  used 
in  map  building  and  path  planning.  I  w  as  shown  that  given  a  map  represented  in  an 
ANN,  the  shortest  path  from  one  point  to  another  can  be  found  quickly. 

Visually  guided  movements:  learning  w  ith  modular  neural  maps  in  ^gg^ 

robotics.  Jean-Luc  Buessler,  Jean-Fhilippe  Urban 

A  modular  ANN  is  used  to  control  3  DOF  robotic  arm  w  ith  arm  position  images  as  an 
input.  The  neural  structure  consists  of  two  layers,  one  layer  to  select  a  Neuromodule 
to  control  the  arm  at  a  given  time,  and  a  second  layer  consisting  of  Neuromodules 
optimized  for  specific  situations.  ANN  used  ADB.I'C model  neurons.  ANN  weights 
updated  w  ith  the  Normalized  least  mean  square  (NLMS)  rule. 

Stable  manipulator  trajectory  control  using  neural  netw  orks.  ^^g^ 

Yichuang  Jin,  Tony  Rpe,  Alan  Winfield 

ANN  trained  to  control  sinxilated  2  link  robotic  arm  as  well  as  sinxilated  FUW\  560 
manipulator.  Research  showed  that  offline  training  of  ANN  guarantees  stability  and 
convergence  to  w  eight  solution  w  ithin  the  training  set,  and  online  training  guarantees 
stabiNty  and  asymptotic  convergence  to  solution.  Conventional  adaptive  controllers 
converged  to  solution  faster  than  ANN.  Authors  suggest  using  hybrid  controller 
consisting  of  ANN  and  conventional  controllers 

BISMARC:  a  biologically  inspired  system  for  map-based  .jgg^ 

autonomous  rover  control.  Terry  Huntsbrger,  John  Rose 

ANN  used  in  fuzzy  self  organizing  feature  map  (FSOFM)  and  action  selection 
algorithm  to  control  3  robots  moving  in  a  simulated  Martian  environment.  Robots 
retrieved  4  w  idely  separated  containers  w  ith  a  98.9%  success  rate.  Control  system 
used  stereo  vision  as  an  input,  along  w  ith  gtobal  positbn  information. 

Evolutionary  neurocontrollers  for  autonomous  mobile  robots.  D 

Floreano,  F  Mondada 

Used  a  recurrent  neural  netw  ork  w  Ith  eight  inputs  and  tw  o  outputs  to  control  a 
Kedema  robot.  Robot  learned  to  avoid  colfisbns  in  a  circular  maze.  ANN  w  eights  w  ere 
adjusted  w  ith  a  genetic  algorithm  Adapted  ANN  was  transferred  to  a  larger  Koala 
robot,  w  hbh  qubkty  barned  to  navigate  in  a  larger  maze. 

Evolutionary  robots  w  ith  orvline  self-organizatbn  and  behavioral  ^qqq 

fitness.  D  Floreano,  J  Urzelai 

Used  ANN  in  robot  control.  Khepera  robot  was  trained  to  expbre  an  area  until  it  ran 
out  of  energy,  then  return  to  recharge  station.  ANN  was  fully  recurrent,  discrete  time, 
with  12  neurons.  Genetb  algorithm  used  to  adjust  the  way  ANN  learns  (genes  coded 
for  4  hebb  rules  used  for  weight  adjustment  In  ANN).  Reinforcement  learning  was 
used  to  teach  indivbual  robots  in  population  to  acconrpksh  task.  Best  adapted  ANN 
from  genetb  algorithm  was  transfered  to  a  new  robot  (larger  Koala  robot),  where  it 
quickly  learned  to  acconrplsh  the  same  task  (even  with  different  ANN  Inputs). 
Researchers  proposed  a  "fitness  space"  to  ab  in  the  selection  and  classifbatbn  of 
ANN  fitness  functions. 

Fuzzy  and  recurrent  neural  netw  ork  rrotion  control  among 

dynarric  obstacles  for  robot  manipulators.  Jean  Bosco  Mdede,  2001 

Wu  Wei,  Qisen  Zhang 

A  hybrb  neuro-fuzzy  controlter  is  devebped  to  control  motor  torques  In  a  simulated  3 
DOF  robotb  manipulator.  System  used  a  modified  Bman  NN.  Simulated  manipulator 
was  able  to  avob  moving  obstacles,  and  adapt  to  changes  b  dynarncs  in 
manipulator. 

Reinforcement  learning  neural  netw  ork  to  the  problem  of 

autonomous  mobie  robot  obstacle  avoidance.  Bing-Qiang  Huang,  2005 

Guang-Yi  Cao,  Mn  Guo 

ANN  used  to  control  a  sinrulated  robot  in  an  environment  w  ith  obstacles.  ANN  used  Q- 
learning  w  ith  back  propagatbn  to  optimize  ANN  connectbn  weights.  ANN  used  had  8 
bput  rxxles,  16  hbden  nodes,  and  5  output  nodes.  Robot  navigated  around  obstacles 
w  Ithout  errors  after  500  w  eight  adjustment  epochs. 
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A  unique  configuration,  known  as  an  Underpowered  Aircraft,  allows  for  the  modification 
of  gliding  flight  vehicles  for  increased  range  and  lower  cost  when  compared  with  fully 
powered  flight  vehicles.  Intentionally  under-sizing  the  powerplant  for  a  flight  vehicle  allows 
the  designer  to  choose  a  powerplant  that  will  not  only  perform  the  mission  requirements,  but 
will  also  provide  the  customer  with  the  most  cost  effective  solution,  as  some  missions  may  not 
require  fully  powered  flight.  Specifically,  the  underpowered  aircraft  concept  studied  in  this 
paper  is  a  gliding  flight  aircraft  that  does  not  have  enough  power  for  climbing  or  level  flight, 
but  does  have  enough  power  to  overcome  some  of  the  drag  forces  associated  with  flight,  in 
turn  increasing  the  effective  range  of  the  vehicle.  In  this  paper,  the  underpowered  aircraft 
concept  was  analyzed  and  its  feasibility  was  determined.  Analysis  done  using  equations  of 
motion,  followed  by  a  more  accurate  numerical  integration  including  a  thrust  lapse, 
determined  that  the  underpowered  aircraft  concept  provides  a  unique  method  for  a  cost 
effective  range  extension  technology  for  gliding  flight  vehicles.  Finally,  the  technology  and 
methods  of  this  paper  were  applied  to  the  AGM-154  JSOW  and  JSOW-ER  glide  munitions 
and  it  was  determined  that  JSOW-ER  is  representative  of  an  underpowered  aircraft  with 
our  analysis.  This  paper  represents  a  “back-of-the-envelope”  investigation  into  the 
underpowered  aircraft  concept. 


Nomenclature 

English 

V 

velocity 

AR 

= 

aspect  ratio 

W/P 

power  loading 

AR* 

= 

representative  aspect  ratio  =  eAR 

4 

energy  height 

Cd 

= 

drag  coefficient 

Cl 

= 

lift  coefficient 

Greek 

D 

= 

drag 

a  = 

angle  of  attack 

W 

= 

weight 

propeller  efficiency 

E 

- 

energy 

d 

flight  path  angle 

e 

= 

Oswald  efficiency  factor 

(PT  = 

thrust  vectoring  angle 

h 

height,  altitude 

1  1 

Subscripts 

K 

= 

neAR  nAR* 

max  = 

maximum 

0  = 

parasite 

L 

lift 

T 

thrust 

L/D 

= 

lift  to  drag  ratio 

to  = 

takeoff 

m 

= 

mass 

P/W 

= 

power  to  weight  ratio 

Acronyms 

Ps 

= 

specific  excess  power 

KE 

kinetic  energy 

R/C,  RoC 

= 

rate  of  climb 

PE 

potential  energy 

T 

thrust 

UAV 

unmanned  aerial  vehicle 

T/W 

= 

thrust  to  weight  ratio 
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I.  Introduction 

IT  is  not  typical  for  an  aircraft  designer  to  undersize  the  powerplant  for  their  aircraft.  However,  as  the  emphasis 
on  cost  in  the  aerospace  industry  continues  to  increase,  the  need  to  meet  customer  requirements  through  the 
most  cost  effective  means  presents  itself  in  almost  all  engineering  problems.  In  a  time  where  the  cost  of  fuel  is 
fluctuating  unpredictably,  manufacturing  and  labor  costs  are  increasing,  and  high  technology  systems  bring  the 
development  cost  up,  the  need  to  perform  and  fly  a  mission  must  be  as  cost  effective  as  possible.  Using  the 
technology  of  an  “underpowered’'  aircraft  (an  aircraft  that  only  has  enough  power  to  overcome  some  of  the  drag 
forces  associated  with  flight)  has  the  potential  to  reduce  the  operating  and  propulsion  system  cost  when  compared  to 
standard  aircraft  systems  that  are  capable  of  climbing  or  level  flight.  Possible  mission  applications  for  the 
technology  include  cargo  delivery  for  deployed  troops  in  the  battlefield,  glide  munitions,  stand-off  weapons,  and 
others. 

The  underpowered  aircraft  concept  comes  from  the  idea  that,  for  specific  missions,  an  aircraft  system  may  not 
necessarily  need  to  overcome  all  of  the  drag  forces  associated  with  flight,  and  can  therefore  operate  with  an  under¬ 
sized  powerplant.  If  the  purpose  of  the  aircraft  is  to  glide  to  its  target,  then  the  effective  range  of  the  aircraft  can  be 
increased  by  making  the  aircraft  underpowered.  By  doing  so,  the  aircraft  does  not  need  the  same  power  as  a  standard 
aircraft  would  to  achieve  level  or  climbing  flight,  but  can  successfully  operate  off  of  smaller  amounts  of  power 
while  greatly  extending  the  range  of  the  vehicle.  Adding  power  to  the  aircraft,  in  small  amounts,  allows  the  aircraft 
to  increase  the  effective  mission  range,  for  little  horsepower  and  low  cost,  as  will  be  shown  in  this  paper.  The 
performance  of  an  underpowered  aircraft  will  be  analyzed  and  the  cost  advantages  will  be  determined.  A  more 
detailed  numerical  integration  analysis  of  the  flight  path  will  also  be  presented  and  validation  of  the  analysis  will  be 
conducted  when  compared  to  a  glide  munition  operating  off  of  the  same  flight  principles. 

II.  Underpowered  Aircraft  Performance 

The  idea  of  an  underpowered  aircraft  arises  to  fill  the  need  to  increase  the  range  of  gliding  aircraft  systems. 
Payload  delivered  using  a  gliding  system  provides  for  a  cheap  and  simple  delivery  mechanism  when  constructed 
from  light  weight,  inexpensive  materials.  The  system  can  be  designed  to  be  single  use  or  reusable,  depending  on  the 
exact  purpose.  However,  just  using  a  standard  gliding  aircraft  does  not  provide  the  range  capability  often  needed  for 
payload  delivery.  Assuming  the  underpowered  aircraft  is  dropped  from  a  high  altitude,  an  engine  can  be  sized  and 
selected  to  provide  the  desired  range.  The  trade  space  between  range,  flight  velocity,  and  drop  altitude  for  an 
underpowered  aircraft  will  be  explored.  The  following  analysis  will  assume  a  payload  delivery  mission  and  then 
other  mission  profiles  will  be  analyzed  afterwards. 

Two  methods  were  used  to  determine  the  performance  for  the  underpowered  aircraft.  First,  the  standard  method 
of  looking  at  the  forces  acting  on  the  aircraft  via  a  free-body  diagram  was  applied.  Estimates  for  the  drag  polar  of 
the  aircraft  were  also  developed,  which  yielded  an  estimate  of  flight  conditions.  This  was  followed  by  a  numerical 
integration  to  provide  a  more  accurate  measure  and  to  account  for  thrust  lapse.  Emphasis  was  placed  on  the  lift  to 
drag  ratio  {L/D)  due  to  the  vehicle’s  operation  in  gliding  flight.  In  an  abstract  trade  study  such  as  this,  aircraft 
characteristics  are  treated  as  technology  that  can  be  applied  to  an  aircraft  in  the  design  process,  allowing  for  an 
overall  performance  trade  study. 

A.  Equations  of  Motion  Analysis 

To  start.  Figure  1  shows  the  standard  forces  acting  on  an  aircraft  in  flight  for  use  in  the  equations  of  motions 
analysis. 


Figure  1.  Forces  Acting  on  an  Aircraft  in  Flight 

American  Institute  of  Aeronautics  and  Astronautics 
2 


The  forces  acting  on  the  aircraft  are  standard  and  include  the  lift,  drag,  thrust,  and  weight  of  the  aircraft.  The 
velocity,  flight  path  angle,  6,  and  the  angle  of  attack,  a,  are  also  shown.  The  flight  path  angle  is  defined  as  the  angle 
between  the  horizontal  and  the  velocity  vector  and  the  angle  of  attack  is  defined  as  the  angle  between  the  velocity 
vector  and  the  arbitrarily  defined  body  axes  for  the  aircraft.  In  the  case  of  thrust  vectoring,  the  thrust  vector  is  offset 
by  the  angle  (pr,  to  model  any  effects  irom  thrust  vectoring  on  the  performance  of  the  aircraft. 


This  analysis  assumes  that  there  is  no  thrust  vectoring  happening  in  the  flight  of  the  aircraft.  Thus,  summing  the 
forces  in  the  X  and  Z-axis  for  steady  flight  yields 


T  =  D-^W  sine 
L  =  W  cos  0 

Thus,  we  reorganize  equation  1  to  find  the  classical  aircraft  performance  equation 


sin0  = 


7-D 

w 


(1) 

(2) 

(3) 


For  gliding  flight,  our  interest  lies  in  the  flight  path  angle,  6,  of  the  vehicle.  By  minimizing  the  flight  path  angle 
to  a  small  negative  number,  the  range  of  the  aircraft  can  be  maximized.  So,  we  have 


e  =  sin^^  (-  -  -) 
\w  wJ 

From  equation  2  above  and  a  small  angle  approximation,  we  have 


With  the  power  to  weight  ratio  (in  units  of  hp/lb)  defined  as 

V 


-=(-) 

w  \wJ 


SSOTjp 


(4) 


(5) 


(6) 


B.  Drag  Polar 

One  of  the  key  characteristics  needed  to  properly  model  the  performance  of  an  aircraft  is  an  accurate 
representation  of  the  drag  polar  for  the  entire  aircraft.  The  form  of  the  drag  polar  that  will  be  used  for  the  analysis  is 


“  ^Do  4- 


nAR* 


(7) 


For  the  purposes  of  this  study,  the  aspect  ratio,  AR,  of  the  aircraft  will  be  grouped  together  with  the  Oswald 
efficiency  factor,  e,  to  become  a  representative  aspect  ratio,  AR"^.  In  an  abstract  trade  study  such  as  this  no 
information  is  available  on  the  efficiency  of  the  wing  design;  however  a  feel  for  the  efficiency  factor  can  still  be 
gained  through  a  representative  aspect  ratio.  If  we  assume  that  the  aircraft  is  operating  at  conditions  that  give  the  Q 
for  best  L/D  for  the  gliding  condition,  then  we  know  that^ 


So,  the  lift  to  drag  ratio  is 


Cn  =  2C 


Do 


I - 

il  —  —  I  1 

^max  y'^^AR*CDo 


(8) 

(9) 


(10) 
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Reorganizing,  an  estimate  of  the  parasite  drag  can  be  determined  through 

(12) 

<LJ 

This  allows  us  to  treat  the  aerodynamics  of  the  aircraft,  AR*  and  -  ,  as  technology. 

^max 

III.  Powerplant  Cost  Estimation 

With  the  performance  for  the  underpowered  aircraft  concept  established,  the  cost  benefits  of  the  technology  w  ere 
determined.  Such  a  vehicle  can  be  powered  either  by  traditional  internal  combustion  piston  engines  or  small  jet 
turbine  engines.  In  order  to  get  an  estimate  for  the  cost  saving  of  the  vehicle,  estimates  of  small  piston  and  jet 
turbine  engines  were  developed.  As  seen  below'  in  Figure  2,  a  span  of  cost  competitive  small  piston  engines  was 
used  to  determine  a  cost  trend  that  was  acquired  through  a  survey  of  retail  prices  found  online  in  August,  2008. 
These  engines  included  small  RC  aircraft  engines  from  O.S.  Engines,  general  purpose  engines  from  Honda  and 
Kawasaki,  as  well  as  a  few  larger  Rotax  aircraft  engines.  The  model  yields  an  excellent  correlation  coefficient  and 
the  results  are  consistent  with  the  investigative  nature  of  this  paper. 
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Figure  2.  Smaii  Piston  Engine  Cost 

Figure  3  shows  a  similar  trend  for  small  jet  turbine  engines.  Due  to  the  fact  that  the  payload  delivery  vehicles 
and  stand-off  “glide  munitions”  where  this  technology  would  be  used  are  not  large  in  size,  the  engine  study  was 
limited  to  model  aircraft  jet  engines  as  well  as  jet  engines  used  in  small  UAV  applications.  These  engines  include 
manufacturers  such  as  JelCal,  foreign  engine  manufacturers  such  as  SimJet,  and  others.  This  model  is  indicative  of 
the  low  thrust  engines  needed  for  underpowered  applications.  The  model  yields  acceptable  results  with  a  correlation 
coefficient  of  82%. 
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IV.  Underpowered  Aircraft  Flight  Performance 

Since  the  concept  for  this  aircraft  is  based  on  that  of  a  glider,  the  performance  of  the  aircraft  has  been  determined 
to  represent  the  trade  space  of  velocity,  range,  and  drop  altitude.  So,  using  the  relationships  derived  earlier  and 
performance  code  written  in  MATLAB,  some  performance  trends  were  calculated. 

It  is  assumed  in  this  analysis  that  the  underpowered  aircraft  is  dropped  from  altitude  at  the  start  of  the  flight.  Two 
altitudes  of  10,000  feet  and  25,000  feet  were  chosen  to  give  a  comparison  between  a  low  altitude  drop  and  a  high 
altitude  drop.  The  drop  aircraft  could  consist  of  any  type  of  vehicle  that  is  capable  of  carrying  the  underpowered 
aircraft  to  the  drop  altitude.  Winds  aloft  are  not  included  in  the  analysis.  The  analysis  presented  assumes  that  the 
underpowered  vehicle  is  dropped  at  the  velocity  of  best  L/D  and  that  during  the  glide  the  vehicle  operates  at  the  best 
L/D  for  glide. 

As  the  lift  to  drag  ratio  is  increased,  the  thrust  required  to  get  the  aircraft  to  reach  its  destination  decreases,  which 
can  be  seen  in  Figure  4.  Only  a  small  amount  of  thrust  is  required  to  keep  the  aircraft  in  a  level  flight  condition,  but 
a  significantly  larger  amount  of  thrust  is  needed  to  have  a  px)sitive  rate  of  climb  for  the  aircraft  (represented  by  the 
+3  degree  climb  angle  curve).  The  difference  in  gliding  flight,  level  flight,  and  positive  rate  of  climb  flight  is 
indicative  of  the  trade  space  between  range,  velocity,  and  drop  altitude  (10,000  feet  for  these  curves).  It  is  also 
indicative  of  the  trade  in  the  cost  of  the  system,  as  having  an  aircraft  that  is  capable  of  positive  rate  of  climb  requires 
a  significantly  larger  amount  of  thrust  and  therefore  a  larger,  more  expensive  powerplant.  It  is  important  to  note  that 
there  are  no  additional  assumptions  built  into  the  figure  below  and  the  plot  is  derived  solely  from  aircraft 
performance  metrics. 
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Figure  4.  Underpowered  Jet  Aircraft  Performance  from  a  10,000  ft  Drop  Altitude 


The  curves  in  Fig.  4  are  a  function  of  thrust  to  weight  ratio  and  lift  to  drag  ratio  which  are  two  of  the  most 
fundamental  aircraft  performance  parameters.  For  these  initial  calculations  the  thrust  lapse  has  been  ignored.  Using 
the  cost  model  presented  earlier  we  can  estimate  the  cost  saving  of  the  underpowered  aircraft  technology.  Assuming 
that  the  vehicle  has  a  takeoff  gross  weight  (TOGW)  of  1 ,500  pounds  and  can  achieve  a  lift-to-drag  ratio  (L/D)  of  20, 
the  vehicle  requires  a  thrust  to  weight  ratio  0.04  to  achieve  a  range  of  200  nmi.  This  corresponds  to  a  thrust  required 
of  60  Ibf  and  an  engine  cost  of  $7,862.  In  contrast,  the  engine  would  need  to  provide  75  Ibf  for  level  flight  and  1 50 
Ibf  for  climbing  flight.  This  yields  a  cost  of  $9,500  and  $17,095,  respectively. 

The  same  curves  can  be  represented  for  a  propeller  driven  aircraft  by  including  flight  velocity  and  propeller 
efficiency.  Shown  in  Figure  5  are  the  same  trends  as  a  function  of  power  to  weight  ratio. 


Lift  to  Draq  Ratio 

Figure  5.  Underpowered  Propeller  Aircraft  Performance  from  a  10,000  ft  Drop  Altitude 
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Figure  5  shows  similar  trends  to  Figure  4.  This  plot  speaks  volumes  about  the  underpowered  aircraft  concept.  If 
we  assume  that  the  underpowered  aircraft  can  achieve  a  maximum  lift  to  drag  ratio  of  20  and  has  a  TOGW  of  1,500 
pounds,  then  the  aircraft  only  requires  about  20  hp  to  achieve  a  range  of  200  nmi  (even  less  for  shorter  ranges).  The 
same  aircraft  would  require  26  hp  for  level  flight,  and  about  53  hp  for  climbing  flight.  The  underpowered  aircraft 
requires  over  one  half  the  horsepower  to  achieve  the  mission  requirement  which  translates  to  engine  costs  of  $1,577, 
$1,983,  and  $3,694  respectively.  There  are  two  main  assumptions  built  into  this  analysis:  First,  a  propeller  efficiency 
of  0.80  is  assumed  to  convert  from  thrust  to  horsepower  (80%  being  typical  performance  of  most  propellers 
currently  used  today)  and  second,  an  operating  velocity  of  100  mph  (146.6  ft/sec)  was  arbitrarily  chosen  to  represent 
a  reasonable  delivery  speed  for  the  payload  aircraft. 

A  different  presentation  of  the  data  in  Fig.  5,  seen  below  in  Fig.  6,  shows  the  relationship  between  power  loading 
and  lift  to  drag  ratio  for  the  underpowered  aircraft. 


Lift  to  Drag  Ratio 


Figure  6.  Underpowered  Aircraft  Power  Loading  Requirements  for  a  10,000  ft  Drop  Altitude 

This  figure  shows  how  much  of  the  aircraft  (in  weight)  can  be  supported  for  each  unit  of  horsepower  that  the 
engine  on  the  aircraft  will  produce.  If  we  again  assume  that  the  aircraft  has  a  lift  to  drag  ratio  of  20  and  a  weight  of 
1,500  pounds,  then  the  aircraft  can  carry  about  76  pounds  for  each  horsepower.  This  results  in  a  power  to  weight 
ratio  of  0.013  hp/lb  and  about  a  20  hp  engine  as  shown  above  in  the  previous  figures.  This  analysis  also  assumes  a 
propeller  efficiency  of  0.80  and  a  flight  velocity  of  100  mph  as  mentioned  earlier. 

The  same  graphs  were  created  to  look  at  the  performance  of  the  aircraft  from  the  drop  altitude  of  25,000  feet. 
Note  the  significantly  less  power  required  for  the  underpowered  aircraft  to  achieve  a  desired  range  of  200  nmi  in 
Figure  7. 
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Figure  7.  Underpowered  Jet  Aircraft  Glide  Performance  from  a  25,000  ft  Drop  Altitude 

If  we  continue  to  assume  that  the  aircraft  has  a  TOGW  of  1,500  pounds  and  can  achieve  a  lift-to-drag  ratio  of  20, 
the  vehicle  will  require  a  thrust  to  weight  ratio  of  0.03  to  achieve  a  200  nmi  range,  a  thrust  to  weight  ratio  of  0.05  to 
achieve  level  flight,  and  a  thrust  to  weight  ratio  of  0.1  to  achieve  a  positive  rate  of  climb.  From  the  cost  models 
presented  above,  the  engine  would  need  45  Ibf  thrust,  75  Ibf  thrust,  and  150  Ibf  thrust  respectively.  This  would 
represent  a  significant  cost  savings  between  $6,161,  $9,500,  and  $17,095  respectively. 

Shown  in  Figure  8  is  the  relationship  between  power  to  weight  ratio  and  lift  to  drag  ratio. 
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Figure  8.  Underpowered  Propeller  Aircraft  Performance  from  a  25,000  ft  Drop  Altitude 


American  Institute  of  Aeronautics  and  Astronautics 
8 


Using  the  same  assumptions  as  before  and  looking  at  an  aircraft  that  can  achieve  an  aerodynamic  lift  to  drag  ratio 
of  20,  and  has  a  weight  of  1,500  pounds,  the  aircraft  will  require  a  power  to  weight  ratio  of  0.01  hp/lb  or  15  hp  to 
reach  the  desired  range  of  200  nmi.  This  would  be  a  minimal  cost  of  SI, 227.  This  is  significantly  less  than  an 
aircraft  that  would  need  to  sustain  level  flight  (approx.  26  hp  or  SI, 983)  and  an  aircraft  looking  to  have  a  positive 
rate  of  climb  (approx.  53  hp  or  S3, 694).  The  underpowered  aircraft  technology  will  satisfy  the  requirements  with 
significantly  less  cost  due  to  the  much  smaller  engine  required  which  reduces  cost  throughout  the  life  cycle.  These 
values  are  sensitive  to  wing  technology  (lift  to  drag  ratio)  and  will  change  depending  on  the  L/D  that  can  be 
achieved  for  the  vehicle. 

The  power  loading  for  the  underpowered  aircraft  also  significantly  changes  for  the  additional  drop  altitude  of 
25,000  feet  and  allows  the  aircraft  to  glide  a  longer  distance  with  less  power. 


Figure  9.  Underpowered  Aircraft  Power  Loading  Requirements  for  a  25,000  ft  Drop  Altitude 

Comparing  the  two  drop  altitudes  shows  significant  savings  as  well.  Using  the  same  aircraft  assumptions  as 
before,  namely  a  TOGW  of  1,500  pounds  and  a  maximum  lift  to  drag  ratio  of  20,  we  see  that  a  drop  from  10,000  ft 
achieves  200  nmi  with  a  60  Ibf  engine  and  an  engine  cost  of  $7,862.  This  cost  is  decreased  when  dropped  from 
25,000  ft,  when  the  plane  achieves  the  same  range  with  a  45  Ibf  engine  and  an  engine  cost  of  $6,161. 


V.  Numerical  Integration  Approach 

While  the  above  analysis  represents  a  “back-of-th e-envelope  approach”,  there  is  one  main  factor  that  was  left 
out;  the  effects  of  velocity  and  altitude  on  powerplant  performance.  This  takes  the  form  of  a  thrust  lapse  that  will 
change  the  maximum  thrust  to  weight  ratio  represented  in  the  earlier  figures,  to  a  typical  flight  thrust  to  weight  ratio 
that  has  been  adjusted  to  represent  actual  flight  conditions.  To  achieve  this,  a  numerical  integration  approach  was 
used  to  examine  the  equations  of  motion,  take  a  thrust  lapse  into  account,  and  give  more  accurate  results  than  the 
methods  presented  above. 

Revisiting  the  free  body  diagram  in  Figure  1  and  summing  the  forces  in  the  X  and  Z-axis,  we 
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Due  to  the  fact  that  our  interest  lies  in  gliding  flight,  we  are  actually  interested  in  the  change  in  altitude  of  the 
vehicle  during  flight  with  respect  to  the  change  in  distance  the  vehicle  travels  along  the  ground.  This  is  essentially 
the  glide  ratio  in  derivative  form.  So,  using  the  free  body  diagram 

ds  ^ 

dh  ^  tan9  ^  ^ 

dt 


1  _  L 

tane  “  T-D 


(16) 


Using  a  thrust  lapse  equation  from  Mattingly^  defined  in  terms  of  the  Mach  number.  A/,  and  the  density  ratio 
from  sea  level,  cr,  we  have 

a  =  0.76{0.907  +  0.262(|M  -  (17) 


Setting  up  the  integral  to  integrate  the  flight  path  during  steady  flight,  we  have 


Jh  J  aT-D 


dh 


(18) 


.0 


(19) 


The  numerical  integration  yielded  results  that  provide  a  better  representation  of  the  flight  regime  with  the 
inclusion  of  a  thrust  lapse.  The  trend  in  the  curves  shows  that  the  numerical  model  actually  requires  more  thrust  than 
the  equation  of  motion  or  energy  method  analysis  because  it  now  takes  powerplant  performance  into  account.  The 
powerplant  will  not  perform  at  sea  level  static  conditions  at  high  altitude.  In  an  effort  to  validate  the  results  of  the 
model  presented  above,  a  drop  altitude  of  40,000  ft  was  used  to  match  the  ranges  given  for  the  AGM-154  Joint 
Standoff  Weapon^.  Figure  10  shows  the  results  of  the  numerical  integration. 


Figure  10.  Numerical  Integration  of  Jet  Engine  with  Lapse  from  40000  ft,  Contours  of  Glide  Range 


American  Institute  of  Aeronautics  and  Astronautics 
lO 


According  to  the  AGM-1 54  product  card^  the  unpowered  version  of  the  JSOW  has  an  effective  glide  range  of  70 
nmi  from  a  40,000  ft  drop  altitude.  When  using  the  analysis  of  Figure  10,  for  an  un-powered  vehicle,  this 
corresponds  to  a  lift  to  drag  ratio  of  about  11.  The  weight  reported  for  this  vehicle  is  1,050  Ibf  (depending  on 
variant)^  Recently  reported  in  a  Raytheon  press  release^  was  a  powered  version  of  the  JSOW,  the  JSOW-ER,  with  a 
300  nmi  range  using  a  150  Ibf  thrust  turbojet  engine.  If  we  assume  that  the  powered  version  is  also  dropped  from 
40,000  ft,  and  using  the  same  L/D  as  determined  for  the  un-powered  version,  the  weight  of  the  powered  JSOW-ER 
was  determined  to  be  1 ,575  Ibf  This  is  very  close  to  the  weight  reported  for  the  un-powered  version,  and  shows  that 
the  JSOW-ER  is  most  likely  an  “underpowered”  vehicle,  utilizing  the  technology  described  in  this  paper. 

As  an  estimation  technique,  the  simpler  equation  of  motion  analysis  was  calibrated  to  match  the  results  of  the 
numerical  integration  analysis.  Figure  1 1  shows  the  same  curves  for  the  simpler  analysis,  including  the  same  thrust 
lapse  model  presented  above,  but  the  density  ratio  is  estimated  at  an  altitude  of  18,000  ft.  This  was  considered  a 
good  estimate  for  our  purposes  of  modeling  the  flight  regime  because  most  of  the  effects  of  the  thrust  lapse  are  seen 
at  lower  altitudes  for  longer  ranges. 


Lift  to  Drag  Ratio 

Figure  11.  Estimated  JSOW  Glide  Performance  from  40000  ft 
VI.  Conclusion 

An  underpowered  aircraft  concept  was  studied  to  determine  the  feasibility  and  cost  effectiveness  of  such  a 
technology,  as  well  as  possible  applications.  It  was  determined,  through  an  equations  of  motion,  energy  method,  and 
numerical  integration  analysis,  that  an  underpowered  aircraft  can  provide  significant  range  extension  for  a  gliding 
flight  vehicle.  The  methods  also  include  a  built  in  thrust  lapse  to  correctly  model  an  underpowered  vehicle’s 
performance  with  altitude.  Also,  the  methods  developed  in  this  paper  were  compared  with  a  current  gliding  vehicle, 
the  AGM-154  JSOW  and  JSOW-ER.  It  was  determined,  from  aircraft  metrics  provided  by  Raytheon  and  our 
analysis,  that  the  JSOW-ER  is  most  likely  an  underpowered  aircraft  and  is  representative  of  a  possible  mission 
application  for  the  technology.  Other  applications  include  payload  delivery,  glide  munitions,  UAVs,  and  others. 
Overall,  the  underpowered  aircraft  technology  represents  a  unique  flight  regime,  giving  great  benefit  to  the  user  for  a 
low  overall  cost. 
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1  Introduction 


The  United  States  Marines’  plan  for  Sebasing  and  Distributed  Operations  (DO)  requires  the 
eapability  to  deliver  supplies  from  a  floating  warehouse  directly  to  small  scattered  groups  of 
Marines  in  the  field.  UAV’s  present  an  ideal  solution  to  missions  which  are  Dull,  Dirty,  or 
Dangerous;  low-cost  and  highly  autonomous  systems  add  Distributed  to  that  list.  Supplying 
Marines  is  Dull,  Dangerous,  and  Distributed.  In  two  years,  we  will  conceive,  design, 
demonstrate,  and  deliver  an  unmanned  aircraft  system  as  a  solution  to  this  challenge. 

AeroMech  Engineering  (AME)  specializes  in  the  design  and  development  of  prototype  and 
production  UAVs  (Figure  I).  AME  has  produced  more  than  750  fully  autonomous  UAVs 
ranging  from  4-lb  battery  powered  aircraft  to  150-lb  jet  powered  aircraft.  AME’s  small  UAVs 
are  currently  operated  in  theater  and  have  accumulated  approximately  70,000  total  flight  hours  to 
date.  From  innovative  avionics  solutions  to  state  of  the  art  mission  planning  software  and  ground 
control  station  hardware,  AME  has  a  high  level  of  eapability  in  all  areas  of  UAV  systems. 


Figure  1:  AeroMech  Engineering’s  San  Luis  Obispo  Facility. 


The  Cal  Poly,  San  Luis  Obispo  Aerospace  Engineering  department  (Cal  Poly)  is  a  highly 
ranked  program  with  a  distinct  design  focus  and  a  strong  connection  to  the  aerospace  industry. 
This  collaboration  will  augment  AME’s  proven  expertise  with  Cal  Poly’s  motivated  students  by 
making  the  cargo  UAV  development  program  the  focus  of  their  senior  design  experience.  The 
Cal  Poly  motto  is  “Learn  by  Doing”;  in  this  project,  the  students  will  do  exactly  that. 

AME  maintains  a  unique  working  relationship  with  Cal  Poly.  AME  provides  both 
engineering  and  fabrication  assistance  to  various  school  programs  including  the  AIAA 
Design/Build/Fly  team,  the  ASCE  Concrete  Canoe  team,  and  the  SAE  Formula  Car  team.  As  a 
high  tech  company  pursuing  many  of  the  diverse  challenges  of  unmanned  systems,  AME’s 
relationship  with  an  applied  research  institution  like  Cal  Poly  is  a  natural  one.  Many  senior 
projects  and  graduate  thesis  topics  have  provided  these  partners  with  a  strong  track  record  of 
collaboration. 


2  System  Requirements 

The  Marine  Corps  is  working  towards  a  concept  of  Distributed  Operations.  One  major 
challenge  to  DO  is  how  to  keep  many  small,  scattered,  and  highly  mobile  groups  of  Marines 
adequately  supplied  so  they  may  complete  their  mission. 
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This  mission  implies  a  set  of  requirements  which  must  be  understood  at  the  start  of  the 
design  process.  A  seabased  cargo  delivery  UAV  will  be  operated  by  a  ship-board  crew  of  non¬ 
experts.  The  system  must  have  minimal  logistical  impact  and  require  no  modifications  to  the 
ship.  The  aircraft  and  system  must  be  compliant  with  the  Department  of  Defense’s  Single  Fuel 
Concept  (SFC). 

As  a  member  of  a  four-man  team  with  a  vehicle,  an  individual  mounted  Marine  requires 
about  92  pounds  of  supplies  each  day.  Summarized  in 

Table  1,  this  includes  four  gallons  of  water,  30%  of  a  combat  load  of  ammunition,  and 
nearly  four  pounds  of  batteries. Of  course,  a  Marine  platoon’s  combat  needs  are  unpredictable 
and  it  will  be  essential  to  tailor  each  delivery  to  the  given  situation.  Five  hundred  pounds  of 
supplies  could  be  packed  in  a  cylinder  about  1 .7  feet  in  diameter  and  6.9  feet  long. 

Table  1:  One  Mounted  Marine’s  Day  of  Supply. ''' 


Weight  (IbO 

Volume  (ft^) 

Food  &  Water 

39.0 

0.9 

Fuel 

23.1 

0.5 

Ammunition 

22.2 

0.5 

Misc.  Supplies 

7.5 

0.2 

Total 

91.8 

2.1 

A  delivery  point  100  miles  inland  leads  to  a  200  mile  mission  radius.  Without  burdening 
them  with  direct  control  of  the  aircraft,  the  Marines  on  the  ground  must  have  the  capability  to  set 
and  change  the  payload  delivery  point  while  the  vehicle  is  on  its  way.  This  mission  demands  a 
high  degree  of  autonomy  with  changing  modes,  operators,  and  objectives. 

Although  every  measure  will  be  taken  to  prevent  aircraft  and  payload  loss,  operational 
robustness  is  a  distinct  advantage  to  a  distributed  delivery  network  utilizing  low  cost  autonomous 
components.  The  implicit  trade  between  system  architecture  complexity  and  accident  rate  is 
effectively  depicted  in  Figure  2. 
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Figure  2:  U.S.  Military  Aircraft  and  UAS  Class  A  Mishap  Rates  (Lifetime),  1986-2006.'*' 


The  limitations  of  current  mission  planning  and  control  software  have  serious  consequences. 
Repeated  studies  have  shown  that  human  factors  are  a  leading  cause  of  UAV  accidents  across 
many  aircraft  types^^^;  estimates  of  the  fraction  of  accidents  caused  or  influenced  by  human 
factors  range  between  32%^^^  and  100%.^'*^  A  USAF  report  on  Predator  mishaps  implicates  the 
Human  Control  Interface  in  89%  of  accidents,  where  its  issues  are  cited  as  the  causal  factor  in 
44%  of  those  accidents. These  facts  strongly  reinforce  the  need  for  a  fully  autonomous  system 
with  advanced  mission  planning  and  control  software  like  AME’s  SharkFin  product. 
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3  System  Concepts  and  Trades 

The  unique  collaboration  proposed  between  AcroMech  Engineering  and  Cal  Poly  will  allow 
us  to  quickly  develop  a  prototype  vehicle  while  thoroughly  exploring  a  vast  system  architecture 
and  operational  concept  space.  In  addition  to  the  traditional  payload/speed/range/eost  trades, 
some  unique  concepts  and  trades  must  be  considered  in  the  development  of  this  system. 

A  first  concept  distinction  can  be  made  between  systems  which  arc  carried  aloft  by  another 
aircraft  before  launch  -  these  systems  capitalize  on  added  potential  energy  to  accomplish  the 
mission.  Dropped  concepts  are  distinct  from  systems  which  operate  and  fly  independently  - 
these  systems  carry  all  of  the  energy  required  for  the  mission  on  board. 

Dropped  system  concepts  are  attractive  because  they  may  improve  the  UAV  system  cost  by 
reducing  the  demands  on  the  propulsion  system  and  energy  storage.  Examples  include  a 
helicopter  or  CV-22  dropped  guided  parachute;  the  limited  glide  range  of  parachutes  would 
demand  a  drop  over  the  combat  zone.  This  limitation  could  be  overcome  by  a  high  lift-to-drag 
vehicle  or  a  slightly  powered  aircraft  dropped  from  a  CV-22  at  significant  altitude.  An  FA- 18 
E/F  could  be  used  to  deliver  a  ‘cargo  bomb’  resembling  a  2000  pound  bomb  or  extended  range 
drop  tank.  Unfortunately,  the  ‘eargo  bomb’  must  be  transferred  from  the  transport  ship  to  the 
aircraft  carrier  for  deployment;  mass  properties  control  for  stores  separation  certification  also 
presents  a  major  obstacle  to  this  concept.  All  boosted  systems  are  limited  by  the  operational 
requirements  of  the  host  vehicle.  These  manned  systems  are  expensive  to  operate  and  arc  under 
very  high  demand  during  a  conflict. 

Independent  systems  eliminate  the  operational  demands  on  manned  aircraft  not  only  in  their 
use,  but  also  in  training,  certification,  etc.  A  rail-launched  UAV  is  likely  the  best  approach  to  this 
challenge;  it  presents  a  simple  architecture  concept  with  minimal  logistical  impact. 

Another  major  operational  distinction  to  be  considered  is  mode  of  recovery  for  the  system. 
The  simplest  system  will  deliver  its  payload  by  landing  near  the  Marine  unit;  such  a  system 
could  be  disposable  or  recovered  at  a  later  date  -  it  may  be  necessary  to  disable  critical  systems. 
Alternately,  terminal  payload  delivery  could  be  accomplished  by  parachute  allowing  the  UAV  to 
be  recovered  at  another  location.  The  UAV  could  return  to  the  ship  for  a  water  landing  or  net 
capture.  Or,  it  may  return  to  a  pre-determined  depot  location  to  be  re-fitted  for  another  use. 
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5  Programmatic  Information 

The  program  will  be  organized  into  two  similar  phases  -  both  spanning  from  design  to 
demonstration  of  an  operational  system.  The  second  phase  will  reiterate  the  design,  incorporating 
lessons  learned  and  customer  feedback  from  the  demonstration  in  Phase  1.  Two  air  vehicles  will 
be  built  in  both  phases. 

Table  2:  Major  Program  Milestones 


Milestone 

Date 

1 

Conceptual  Design  Review 

12/2008 

2 

Preliminary  Design  Review 

01/2009 

3 

Critical  Design  Review 

03/2009 

4 

System  Fabrication  I 

07/2009 

5 

System  Integration  I 

09/2009 

6 

Flight  Test  I 

12/2009 

7 

Demonstration  I 

01/2010 

8 

Design  Optimization/Re-design 

04/2010 

9 

System  Fabrication  I 

06/2010 

10 

System  Integration  II 

08/2010 

11 

Flight  Test  II 

10/2010 

12 

Demonstration  11 

10/2010 

13 

Final  Documentation  Package 

11/2010 

AeroMech  Engineering  and  Cal  Poly  will  collaborate  in  the  design  and  development  of  this 
system.  The  Senior  Design  students,  faculty,  and  staff  will  participate  in  a  development  program 
which  parallels  AME’s  effort.  Cal  Poly’s  design  students  will  receive  regular  design  reviews 
from  the  aerospace  industry  culminating  in  an  annual  review  for  ONR.  This  unique  collaboration 
provides  a  cost  effective  means  to  explore  the  diverse  design  concept  space.  Cal  Poly’s  lessons 
learned  will  feed  back  to  AME’s  engineering  process.  Maintaining  concept  development  and 
risk  reduction  experiments  late  into  the  development  process  this  will  serve  to  reduce  design  risk 
throughout  the  project. 

Table  3:  Program  Schedule 

Norv  'OI  JaiW  Mv'M  Majr'99  M'0»  S<p'09  K«rV09  J«'10  Mw'lO  M'lO  S«p'10  Nav'lO  Jm'H  Mw'll  ‘11 
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System 
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Propulsion 
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Recoveiy' 

(^argo  System 

•  Conceptual  Design  Re\’iew 
•  Pielmuiiary  Design  Re\‘iew 

■  Critical  Design  Review 

R^'  Recfciction  Experuiieiits 

Fabrication  1 

»  ■■  ■■  I  e  Systenw  Iiitegjatioii 

V  Fl^^  Test  1 
^  Denionstratioii  1 
w  '  w  Des^i  Iteration 

FabricatKMin 

S\’steins  Integration  n 
Fliglit  Test  n 
4  Deinonstratioii  11 

V— Repeats 

F^^ogTaiii  Management 
Acbuiiustration 

V  Fttiai  DocittiieiilatKHi  Package 
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6  This  Deliverables 

Proposed  deliverables  for  this  development  effort  include  design  reviews  and  their 
associated  documents,  status  reports,  system  flight  demonstrations,  and  one  fully  operational 
system. 


•  Technical  Progress  Reports  -  weekly  updates,  detailing  technical  progress 

•  Status  Reports  -  monthly  program  status,  including  financials 

•  Risk  Reduction  Experiment  Reports  -  description  and  significant  findings 

•  Design  Reports  -  detailed  reports  accompanying  each  design  review 

•  Design  Reviews  -  face  to  face  presentations  of  current  design  status 

o  Conceptual  Design  Review 
o  Preliminary  Design  Review 
o  Critical  Design  Review 
o  Final  Design  Review 

•  Demonstration  I  -  preliminary  system  demonstration 

•  Demonstration  11  -  final  system  demonstration 

•  Demonstration  Reports  -  description  and  significant  results 

•  Fully  Operational  System  -  delivered  after  Demonstration  11 

o  Air  Vehicle  -  one  to  be  delivered 

■  Cargo  Delivery  System 

o  Ground  Support  Equipment  -  one  to  be  delivered 

■  Launcher 

■  Cargo  Handling  System 

■  Ground  Control  Station  (GCS)  Equipment 

■  Single  Seat  of  GCS  Software 

■  Recovery  System 

•  Final  Documentation  Package  -  summary  documentation 

o  Final  Design  Documentation 
o  System  Operational  Manual 
o  Interface  Control  Document 
o  Interface  Design  Document 
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7  Cost 

The  estimated  cost  for  this  development  effort  is  three  million  dollars  over  a  two  year  effort. 
These  costs  include  those  of  both  Cal  Poly  SLO  and  AeroMech  Engineering,  Inc. 


Task 

Cost 

1 

Design  -  Labor 

$3  70k 

2 

Risk  Reduction  Experiments  Labor 

$250k 

3 

Risk  Reduction  Experiments  -  Materials 

$100k 

4 

System  Fabrication  1  -  Labor 

$400k 

5 

System  Fabrication  I  -  Materials 

$284k 

6 

System  Integration  I  -  Labor 

$115k 

7 

System  Integration  I  -  Materials 

$13k 

8 

Flight  Test  I  -  Labor 

$100k 

9 

Flight  Test  I  -  Materials 

$11.5k 

10 

Demonstration  I  -  Labor 

$35k 

11 

Demonstration  I  -  Materials 

$15k 

12 

Design  Optimization/Re-design  -  Labor 

$150k 

13 

System  Fabrication  II  -  Labor 

$400k 

14 

System  Fabrication  II  -  Materials 

$202k 

15 

System  Integration  II  -  Labor 

$115k 

16 

System  Integration  11  -  Materials 

$9k 

17 

Flight  Test  II  -  Labor 

$100k 

18 

Flight  Test  II  -  Materials 

$11.5k 

19 

Demonstration  II  -  Labor 

$3  5k 

20 

Demonstration  II  -  Materials 

$15k 

21 

Status/Design  Reports  -  Labor 

$110k 

22 

Final  Documentation  -  Labor 

$3  5k 

23 

Program  Management  -  Labor 

$112k 

24 

Administration  -  Labor 

$15k 

25 

Total  Labor 

$2.34M 

26 

Total  Materials  1 

$66  Ik 

27 

Combined  Total 

$3.0  M 
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8  Resumes 

The  following  resumes  constitute  the  key  engineering  personnel,  but  several  other  engineers 
with  extensive  collective  UAV  design,  fabrication,  integration,  and  flight  testing  experience  will 
also  be  employed  in  the  development  effort. 

•  Thomas  Akers  -  Chief  Executive  Officer,  AcroMech  Engineering,  Inc. 

•  Joseph  M.  Wurts  -  Chief  Aerodynamicist,  AeroMcch  Engineering,  Inc. 

•  Rob  McDonald,  PhD  -  Aerospace  Design  Professor,  Cal  Poly  SLO 

•  Michael  Helke  -  Director  of  Business  Development,  AcroMech  Engineering,  Inc. 

•  Patrick  Stewart  -  Senior  Aerospace  Engineer,  AeroMech  Engineering,  Inc.  (PI) 
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Joseph  M.  Wurts 

AeroMech  Engineering,  Inc. 


Work  Experience 

Consulting  work; 

•  Provided  technical  oversight  for  an  Edwards  AFB  Flight  Test  program,  Shear  Wind  Observed  Optimized  Path 
Investigation  (SENIOR  ShWOOPIN),  recommended  optimal  flight  trajectory  methodologies  along  with 
instrumentation  and  data  collection  methods. 

•  Wind  tunnel  data  reduction  of  an  existing  design,  analysis  of  the  data  validity,  recommended  configuration 
upgrade  with  new  control  surface  effectors  to  meet  requirements. 

•  Developed  a  series  of  software  tools  to  generate  CFD  grids  from  unstructured  laser  scan  point  data,  and 
performed  CFD  analysis  to  assess  the  “as-built"  vehicle  flight  performance. 

•  Conducted  sizing  trades  and  configuration  layout  for  a  flight  test  vehicle  researching  body  freedom 
flutter.  Developed  a  structural  stiffness  and  inertial  model  for  a  systems  optimization  to  define  a  flight 
test  article.  Provided  oversight  on  vehicle  manufacture,  assembly,  and  systems  integration.  Defined  flight 
test  methodology  and  piloted  vehicle  at  Edwards  AFB  demonstrating  the  predicted  flutter  phenomena. 

•  Aerodynamic  analysis  of  a  cruise  missile  wing  to  determine  the  cause  of  performance  variance  as 
measured  by  flight  and  wind  tunnel  test.  Determined  causes  of  performance  variance,  recommended 
modifications  to  regain  performance  loss. 

•  Cruise  missile  configuration  sizing  and  optimization,  including  wing  airfoil  design  and  optimization  to 
meet  performance  and  structural  requirements. 

Conceptual  and  preliminary  configuration  sizing  and  development: 

•  Configuration  development  lead  for  several  programs,  performing  conceptual  sizing  trades  and 
aerodynamic  analysis,  configuration  packaging  and  integration,  along  with  customer  interface. 

•  Chief  engineer  and/or  project  manager  on  several  small  UAV  programs,  including  the  DARPA  Micro  Air 
Vehicle,  and  other  classified  programs.  Managed  design  teams  in  both  conceptual  and  preliminary  design 
phases,  providing  technical  guidance  and  managing  the  design  teams  cost  and  schedule. 

•  Lead  designer  on  the  Lockheed  Martin  Tier  11+  high  altitude  long  endurance  unmanned  air  vehicle  concept. 
Developed  the  configuration  from  trade  studies  to  meet  customer  requirements.  Responsible  for  payload, 
structural,  subsystems  and  propulsion  integration.  Authored  configuration  section  of  the  proposal. 

•  Lead  designer  on  the  JASSM  cruise  missile.  Responsible  for  the  overall  configuration  trade  studies  and 
vehicle  development,  as  well  as  integration  of  the  payload,  propulsion  and  subsystems. 

•  Developed  and  refined  configurations  on  the  A-X  program  for  the  Navy.  Integrated  configurations  with  a 
high  priority  on  carrier  suitability. 

•  Lead  designer  on  an  ASTOVL  vehicle,  packaging  challenging  propulsion  systems. 

Core  Skills 

•  Configuration  development  -  working  with  and  understanding  each  of  the  multiple  disciplines  necessary 
for  configuration  development. 

•  Aerodynamic  analysis  and  system  optimization 

Education 

California  Polytechnic  State  University,  San  Luis  Obispo  CA: 

Bachelor  of  Science  Degree  in  Aeronautical  Engineering,  December  1985. 

Masters  of  Science  Degree  in  Engineering,  June  1986. 

Lockheed  Technical  Institute: 

Aircraft  Dynamics  &  Aerodynamics,  Composite  Design  and  Analysis,  Fundamentals  of  Aircraft  Combat 
Survivability,  Low  Observability  for  Designers,  Aircraft  Conceptual  Design,  Fighter  Tactics,  Airframe 
Structural  Design. 

Lockheed  Management  Association: 

Introduction  to  Supervision,  Fundamentals  of  Leadership. 

Accomplishments 

Numerous  (>10)  design  and  invention  patents  awarded. 

1997  Engineering  Merit  Award  From  the  Engineers  Council. 

1 997  Silver  Skunk  for  Teamwork  at  the  Skunk  Works  Honors  Night. 

1  999  Bronze  Skunk  for  Technical  Excellence  at  the  Skunk  Works  Honors  Night. 

1 999  Kelly  Johnson  Inventor  of  the  Year  Award. 


California  Polytechnic  State  University 
Aerospace  Engineering 


Dr.  Robert  A.  McDonald 


ramcdona(acalpoly.cdu 
(805)  756-7242 


Education 

•  Ph.D.  in  Aerospace  Engineering,  Georgia  Institute  of  Technology,  w/  Prof  Dimitri  Mavris 

•  M.S.  Aerospace  Engineering,  Georgia  Institute  of  Technology  (GT) 

•  B.S.  Aerospace  Engineering,  University  of  Missouri-Rolla  (UMR) 

•  Member,  AIAA,  SAE,  ASEE 

Relevant  Employment 

•  Assistant  Professor,  Aerospace  Engineering,  Cal  Poly,  San  Luis  Obispo,  CA 

Faculty  in  charge  of  aircraft  design,  performance,  and  multidisciplinary  design  and  optimization. 

•  Aerospace  Engineer,  AeroMech  Engineering,  San  Luis  Obispo,  CA 

Designed  novel  UAV  configuration.  Developed  electric  UAV  performance  and  sizing  tool. 

Consulting 

•  Hawker  Bcechcraft  PD413 

Conducted  independent  review  of  clean-sheet  aircraft  design. 

•  J.  R.  Gloudemans  -  Vehicle  Structure  Sketch  Pad 

Conceived,  proposed,  and  coordinated  Phase  I  STTR  project  through  NASA  Langley. 

•  Vought  Aircraft  -  Aerodynamic  Design  of  Boeing  Sonic  Cruiser 
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Successful  Research  Proposals 

Unmanned  Aircraft  Systems;  Situational  A  wareness  for  Small  X  X 
Tactical  Unmanned  Aircraft  and  An  Autonomous 
Package  Delivery  Concept  Study  for  the  US  Marines 
REU  Site  —  Summer  Internships  in  Robotics  and  Autonomous 

Systems  PI:  Mohammad  Noori 

A  Multidisciplinary  Geometry  Based  Framework 

Connecting  Design^  Optimization^  Aerodynamics^  and 
Structures 

The  Integrated  Modeling  and  Verification  of  Hybrid  Wing- 

Body, Low  Noise  ESTOL  Aircraft  PI:  David  Marshall 

An  Advanced  Open-Source  Aircraft  Design  Platform  for 
Personal  Air  Vehicle  Geometry,  Aerodynamics,  and 
Structures  PI:  Dimitri  Mavris 
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Sponsor 

Status 

Amount 

Cal  Poly 

Awarded  2/08 

$53,000 

C3RP 

NSF 

Awarded  1/08 

s 

300,000 

NASA  NRA 

Awarded  7/07 

s 

O 

o 

o 

o 

o 

o 

NASA  NRA 

Awarded  7/07 

$ 

874,000 

Phase  1 

NASA 

Awarded  1 1  /06 

s 

100,000 

Phase  1 

Completed  1/07 

STTR 

Journal  Articles 

Riggins,  D.,  Wilson,  C.,  Roth,  B.,  McDonald,  R.,  '"Performance  Characterization  of  Turboshaft  Engines  Using  Work 
Potential  Methods,’’  Journal  of  the  American  Helicopter  Society,  50(4)  2005,  315-315 
McDonald,  R.,  Mavris,  D.N.,  “Formulation,  Realization,  and  Demonstration  of  a  Process  to  Generate  Aerodynamic 
Mctamodels  for  Hypersonic  Cruise  Vehicle  Design,”  SAE  Transactions,  2000,  109(1),  1 138-1 147, 
also  AlAA-2000-01-5559 


Invited  Presentations 

Systems  Analysis  and  Optimization  Technical  Working  Group,  ’’A  Multidisciplinary  Geometry  Based  Framework 
Connecting  Design,  Optimization,  Aerodynamics,  and  Structures",  Reno  NV. 

AIAA  Aircraft  Design  Technical  Committee,  "Design  for  Range",  Tucson  AZ. 

Raytheon  Missile  Systems,  "Error  Allocation  in  Complex  Systems  Design:  A  Fidelity  Trade  Environment",  Tucson  AZ. 


Michael  Helke 

AeroMech  Engineering,  Inc. 


Qualifications 

•  Over  27  years  experience  in  aerospace  industry.  20  years  active  duty  meritorious  service  USAF;  retired 

•  Extensive  knowledge  of  systems,  operations,  leadership,  and  management  ensures  successful  task  completion 

Experience 

Director  of  Business  Development  and  Customer  Relations  (24  November  2007-  present) 

AeroMech  Engineering,  San  Luis  Obispo,  CA 

Systems  Engineer  Staff  IV  (29  March  200S  -  23  November  2007) 

LM  Aeronautics  Co-  Palmdale,  CA  (Chief  Engineer/Program  Manager) 

•  Manages  contract  deliverables,  budgets,  schedules,  and  performance  criteria;  financial  approval  authority 

•  Directs  IPT  leads  on  aspects  of  engineering,  design  tasks,  and  field  support/flight  test  mission  requirements 

•  Performs  analyses  at  all  levels  to  include:  concept,  design,  fabrication,  test,  installation,  operation,  and  maintenance 

•  Coordinates  all  flight  test  activities.  Responsible  for  deployment  logistics 

Sr.  Systems  Engineer  111  (14  April  2003  -  28  March  200S) 

Lockheed  Martin  Co,  Edwards  AFB  CA  (F/A-22  Operational  Test  and  Evaluation  Lead  Engineer) 

•  Directs  avionic  systems  engineers  in  support  of  F/A-22  flight  test  activities  and  maintenance  efforts 

•  Performs  on-aircraft  assessments  of  F/A-22  developmental  test  and  operational  test  avionics  systems  to  include  Radar, 

Electronic  Warfare,  Communication/Navigation/Interrogation,  and  Avionics  Integration 

•  Performs  installation,  verification,  and  monitoring  of  the  F/A-22  avionics  Operational  Flight  Program  (OFP)  software  and 
Common  Integrated  Processor  (CIP)  module  firmware 

•  Mission  Control  Room  lead;  monitors  avionics/aircraft  health  to  provide  pilot  with  real  time  information/reaction  plans 

Senior  Technical  Editor  (31  July  2000  - 13  April  2003) 

EDO  Technical  Services  Operation,  Edwards  AFB  CA 

•  Signature  authority  -  reviews,  edits,  and  rewrites  B-l  bomber  defensive  system  documentation  to  include:  defensive  evaluation 
procedures,  engineering  test  plans,  developmental  test  and  evaluation  reports,  flight  reports,  monthly  status  reports, 
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A  Modification  to  the  Group  Delay  and  Simulated  Annealing 
Technique  for  Characterization  of  Peripheral  Nerve  Fiber  Size 
Distributions  for  Non-Deterministic  Sampled  Data 

Robert  B.  Szlavik 


Abstract  The  ability  to  determine  the  characteristics  of 
peripheral  nerve  fiber  size  distributions  would  provide 
additional  information  to  clinicians  for  the  diagnosis  of  speeifie 
pathologies  of  the  peripheral  nervous  system.  Investigation  of 
these  conditions,  using  eleetro-diagnostie  techniques,  is 
advantageous  in  the  sense  that  such  techniques  tend  to  be 
minimally  invasive  yet  provide  valuable  diagnostic  information. 
One  of  the  principal  electro-diagnostic  tools  available  to  the 
clinician  is  the  nerve  conduction  velocity  test.  While  the 
peripheral  nerve  conduction  velocity  test  can  provide  useful 
information  to  the  clinician  regarding  the  viability  of  the  nerve 
under  study,  it  is  a  single  parameter  test  that  yields  no  detailed 
information  about  the  characteristics  of  the  functioning  nerve 
fibers  within  the  nerve  trunk.  In  previous  work,  the  efficacy  of 
the  group  delay  and  simulated  annealing  approach  was 
demonstrated  in  the  context  of  a  simulation  study  where 
deterministic  functions  were  used  to  represent  the  single  fiber 
evoked  potentials.  In  this  study  we  present  a  modification  to 
the  approach  discussed  previously  that  is  applicable  to  non- 
deterministie  functions  of  sampled  data. 

1.  Introduction 

he  nerve  conduction  velocity  test  provides  clinically 
useful  information  in  the  diagnosis  of  peripheral 
neuropathies,  such  as  Carpal  Tunnel  Syndrome  [1;2]. 
Since  nerve  conduction  velocity  studies  are  essentially  single 
parameter  measurements  of  the  gross  conduction  properties 
of  the  underlying  nerve  trunk,  such  studies  are  not  suited  to 
providing  detailed  information  regarding  the  characteristics 
of  the  underlying  nerve  fibers  that  contribute  to  the 
compound  evoked  potential. 

A  more  robust  measurement  technique  would  involve  the 
ability  to  extract  information  about  the  viability  of  the 
underlying  nerve  fibers  which  could  potentially  provide 
useful  information  to  the  clinician.  As  an  example, 
information  related  to  the  size  distribution  of  contributing 
nerve  fibers  can  be  used  to  differentiate  between  different 
clinical  conditions  such  as  Chronic  Inflammatory 
Demyelinating  Polyneuropathy,  which  selectively  impacts 
larger  nerve  fibers,  or  Early  Diabetic  Peripheral  Neuropathy, 
which  impacts  smaller  fibers  [3;4]. 
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There  is  a  large  body  of  literature  devoted  to  describing 
various  techniques  for  determining  the  nerve  fiber 
conduction  velocity  distribution  (CVD).  The  pioneering 
work  of  Cummins  and  Dorfman  [5;6]  describe  techniques 
that  use  two  compound  action  potentials  to  estimate  the 
conduction  velocity  distribution  using  a  least  squares 
approach.  Common  to  these  studies  was  the  assumption  that 
fibers  included  in  a  specific  velocity  class  have  identical 
evoked  potential  waveforms. 

More  recently  there  have  been  several  additional  studies 
including  the  work  of  Gonzalez-Cueto,  Papadopoulou  and 
Gu  [7-9].  The  study  presented  by  Tu  et.  al  focused  on  a 
regularized  least  squares  algorithm  but  features  many  of  the 
same  assumptions  associated  with  waveform  commonality 
related  to  velocity  classes  that  were  made  in  earlier  work 
[10].  This  study  also  investigated  the  impact  of  noise  on  the 
integrity  of  the  estimated  CVD. 

In  several  recent  publications,  we  have  demonstrated  the 
utility  of  a  group  delay  based  approach  for  determining  the 
size  or  conduction  velocity  distribution  of  fibers  in  a 
peripheral  nerve  trunk  [11].  In  a  subsequent  study,  we 
demonstrated  that  simulated  annealing  could  be  used  to 
optimize  the  group  delay  estimate  of  the  nerve  fiber  diameter 
distribution  in  the  context  of  the  maximal  compound  evoked 
potential  template  [12].  Both  these  studies  involved 
simulations  where  deterministic  functions  were  used  to 
simulate  the  single  fiber  evoked  potentials.  While  this 
approach  was  useful  in  demonstrating  the  overall  efficacy  of 
the  technique,  the  method  by  which  the  technique  would 
have  to  be  modified  to  accommodate  non-deterministic 
sampled  data  was  not  described  and  is  consequently  the 
focus  of  this  study. 

II.  METHOD 

The  principal  difficulty  associated  with  applying  the 
group  delay  and  simulated  annealing  approach  to  non- 
deterministic  sampled  data  is  based  on  the  lack  of  a  suitable 
time  shift,  delay  reference  or  temporal  marker  that  is 
inherent  to  the  deterministic  function  used  to  describe  the 
single  fiber  action  potentials  [13].  What  is  required  is  the 
determination  of  a  suitable  temporal  maker  for  a  non- 
deterministic  function  characteristic  of  what  could  be 
expected  from  the  sample  data  of  the  single  fiber  action 
potential  waveforms  and  P^^(t)  as  per  the  notation 

used  in  previously  published  work  [  1 1 ;  1 2]. 

The  availability  of  a  suitable  time  reference  for  the  non- 
deterministic  case  is  necessary  to  implement  the  simulated 
annealing  algorithm  utilized  to  optimize  the  nerve  fiber  size 
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distribution  estimate  against  the  maximal  compound  evoked 
potential  template.  This  necessity  is  based  on  the  fact  that 
the  simulated  annealing  approach  varies  the  fiber  diameter, 
and  consequently  the  time  delay  of  the  fiber  evoked 
potential,  for  a  randomly  chosen  fiber  in  the  nerve  trunk 
population. 

A  physically  relevant  temporal  parameter  associated  with 
the  individual  decomposed  single  fiber  action  potential 
waveforms  is  the  centroid  of  the  absolute  value  of 

the  waveform  in  question  which  may  be  computed  as  per 

(1). 
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Since  the  standard  physical  interpretation  of  the  centroid  is 
in  the  context  of  masses,  the  functions  evaluated  in  the 
centroid  expression  must  be  positive  for  all  t. 


Figure  1 .  Flowchart  of  the  simulated  annealing  algorithm  that  computes  an 
improved  estimate  of  the  nerve  fiber  diameter  population  set  d  from  the 
group  delay  estimated  population  set  d  for  non-determini  Stic  sampled  data. 

Initially,  sampled  waveforms  are  shifted  such  that  their 
centroids  are  coincident  with  the  propagation  delay 
parameter  for  each  fiber  estimate.  The  centroid  parameter 
for  a  given  single  fiber  evoked  potential  waveform  is  then 
utilized  in  the  simulated  annealing  algorithm  at  the  point 


where  a  randomly  selected  fiber  dj  is  chosen  from  the  group 
delay  estimated  set  d.  A  new  trial  fiber  diameter  ij  is 
generated  and  the  original  randomly  selected  fiber  diameter 
is  set  equal  to  the  new  value  such  that  dy  =  dy.  The 
concomitant  delay  time  5y  is  computed  for  the  randomly 
generated  fiber  diameter.  Utilizing  the  centroid  of  the 
associated  sampled  waveform  for  the  fiber  dy  as  the 

temporal  reference,  the  time  sampled  evoked  potential 
waveform  is  time  shifted  such  that  its  centroid  5y  is 

aligned  with  the  time  delay  5y.  The  rest  of  the  simulated 
annealing  algorithm  proceeds  as  described  in  [12].  Due  to 
the  overall  complexity  of  the  algorithm,  a  further  description 
of  the  modification  is  given  in  the  flow  chart  of  Figure  1. 


111.  RESULTS 

A  population  of  100  randomly  generated  fibers  was 
utilized  in  these  studies  in  accordance  with  the  formula  for 
the  randomly  generated  distribution  outlined  in  previously 
published  work  [11;12].  Parameters  for  the  specific 
distribution  utilized  are  given  in  the  caption  to  Figure  3. 
These  fibers  were  subjected  to  a  virtual  stimulus  pulse  train 
of  successively  increasing  amplitudes  ranging  from  zero  to  a 
maximum  of  1  mA  in  500  nA  steps.  At  each  step  the 
compound  evoked  potential  at  both  virtual  recording  sites 
was  computed  and  subsequently,  the  estimate  of  single  fiber 
action  potential  waveforms  were  obtained  at  each  recording 
site.  The  concomitant  group  delays  between  the  two  virtual 
recording  sites  were  computed  yielding  the  group  delay 
estimated  set  of  fiber  diameters  d. 


Figure  2.  Plot  of  two  typical  single  fiber  evoked  potential  waveforms 
showing  their  centroids,  as  per  (1),  computed  from  a  modified  form  [1 1;12] 
of  the  function  proposed  by  Fleisher  [13].  The  relevant  parameters  for 
Waveform  #1  were  a  -  5  pm,  r  =  0.5  mm,  s  =  \  a,  a,.  -  \  S/m,  <2=  0.998 
and  a  recording  distance  of  25  mm.  For  Waveform  #2,  the  parameters  were 
a  -  5  |im,  r  =  0.5  mm,  s  -  0.5  o,  =  1  S/m,  a  -  0.998  and  a  recording 
distance  of  50  mm.  In  both  cases  c  =  5.0x1 0^  s  ‘.  The  parameter  values  are 
specified  using  labels  consistent  with  previously  published  work  [1 1  ;12]. 
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The  modified  simulated  annealing  technique  with  the 
centroid  approach  described  above  was  then  applied  to  each 
of  the  extracted  evoked  potential  waveforms  in  the  set 
Results  of  the  centroid  computation  are  shown  in  Figure  2 
for  two  single  fiber  evoked  potential  waveforms  with 
parameters  as  indicated  in  the  figure  caption. 


Figure  3.  Graph  of  a  maximal  compound  evoked  potential  template 
waveform  and  the  maximal  compound  evoked  potential  estimate  waveform 
obtained  through  group  delay  estimation  and  simulated  annealing 
optimization.  The  simulated  annealing  algorithm  utilized  the  centroid 
technique  outlined  in  this  paper  with  the  concomitant  time  shifting  of  the 
estimates  of  the  single  fiber  evoked  potential  waveforms  in  The 

relevant  simulation  parameters  for  the  fiber  size  distribution  were  /?/  =  0.35 
m,  Oi  -  1.699  pm,  //;  =  7.5  pm,  =  0.65  m,  02  ^  1.699  pm  and  =  13 
pm.  For  simulation  of  the  initial  single  fiber  evoked  potentials,  the  relevant 
parameters  were  r  ■  1  mm,  c  =  5x10^  s  ',  .v  =  1  o,  cr^  =  1  S/m,  a  -  0.998,  ^ 
=  10  mA  and  T]  =  3.5x10^  m  '.  The  simulated  annealing  algorithm  was 
implemented  with  the  parameters  10,  Twv  “  1.0x10  \  A\f}s  ~  1.0x10"* 
and  an  annealing  step  factor  of  0.9.  The  maximum  number  of  trials  for 
each  annealing  temperature  step  was  limited  to  1000. 

The  graph  of  Figure  3  shows  the  results  of  an  optimization 
of  a  set  of  estimated  singled  fiber  evoked  potentials 
waveforms  at  the  second  recording  site  P^^(t)  against  the 
template  maximal  compound  evoked  potential  waveform. 
Relevant  parameters  for  this  simulation  are  given  in  the 
figure  caption. 

The  chi-square  test  comparing  the  actual  distribution  to 
the  group  delay  estimated  distribution  yields  Q(Z\^)  ~ 
0.4697  while  the  comparison  of  the  actual  to  the  annealed 
distribution  yields  Q(Z\^)  ^  0.7000. 

IV.  DISCUSSION 

It  has  previously  been  demonstrated  by  the  author  that  the 
simulated  annealing  approach  can  make  significant 
improvements  in  fiber  diameter  distribution  estimates  made 
using  the  group  delay  technique.  Based  on  the  modification 
proposed  in  this  paper,  the  technique  is  also  beneficial  when 
applied  to  the  extracted  estimates  of  the  single  fiber  evoked 
potential  waveforms  where  there  is  no  closed  form 
functional  description. 


A  quantitative  description  of  the  relevant  distributions 
using  the  chi-square  test  is  also  revealing  as  to  the  efficacy 
of  the  modified  technique.  The  chi-square  test  indicates  that 
there  is  a  demonstrable  improvement  in  the  fidelity  of  the 
fiber  diameter  distribution  obtained  after  annealing  over  that 
of  the  fidelity  of  the  distribution  that  results  from  just  the 
group  delay  estimation  process  when  compared  with  the 
actual  distribution. 

In  the  author’s  experience,  it  is  advantageous  to  apply  the 
simulated  annealing  algorithm  to  data  sets  at  the  more  distal 
recording  site  from  the  stimulus  site.  Optimization  results  at 
the  more  distal  site  yield  an  improved  estimate  of  the 
optimized  fiber  diameter  distribution  when  compared  to  the 
actual  distribution  than  performing  the  optimization  with  the 
more  proximal  recording  site  data  set. 

References 

[  1]  P.  A.  Parker  and  P.  Kelly,  "Nerve  conduction  velocity  measurement 
techniques,"  Journal  of  Clinical  Engineerings  vol.  7,  no.  2,  pp.  1 53- 
158,  Apr.  1982. 

[2]  1.  Atroshi,  C.  Gummesson,  R.  Johnsson,  and  E.  Omstein, 

"Diagnostic  properties  of  nerv  e  conduction  tests  in  population-based 
carpal  tunnel  syndrome,"  BMC  Musculoskeletal  DisorJerSs  vol.  4, 
no.  9  May2003. 

[3]  Y.  Harati,  "Diabetic  peripheral  neuropathies,"  Annals  of  Internal 
Medicines  vol.  107,  pp.  546-559,  1987. 

[4]  L.  J.  Dorfman,  K.  L.  Cummins,  G.  M.  Reaven,  J.  Ceranski,  M.  S. 
Greenfield,  and  L.  Dobemc,  "Studies  of  diabetic  polyneuropathy 
using  conduction  velocity  distribution  (DCV)  analysis."  Neurology  s 
vol.  33,  no.  6,  pp.  773-779,  Junel983. 

[5]  K.  L.  Cummins,  L.  J.  Dorfman,  and  D.  H.  Pcrkel,  "Ner\  e  fiber 
conduction-velocity  distributions,  II  Estimation  based  on  two 
compound  action  potentials,"  Electro-Encephal.  Clin.  .Neurophysiols 
vol.  46,  no.  6,  pp.  647-658,  1979. 

[6]  L.  J.  Dorfman,  "The  distribution  of  conduction  velocities  (DCV)  in 
peripheral  nerves;  a  review,"  Muscle  &  NerxCs  vol.  7,  no.  I,  pp.  2- 
II, 1984. 

[7]  J.  A.  Gonzalez-Cucto  and  P.  A.  Parker,  "Deconvolution  estimation 
of  nerve  conduction  velocity  distribution,"  IEEE  Transactions  on 
Biomedical  Engineerings  vol.  49,  no.  2,  pp.  140-151,  Feb. 2002. 

[8]  F.  A.  Papadopoulou  and  S.  M.  Panas,  "Estimation  of  the  nerve 
conduction  velocity  distribution  by  peeling  sampled  compound 
action  potentials,"  IEEE  Transactions  on  MagneticSs  vol.  35,  no.  3, 
pp.  1801-1804,  May  1 999. 

[9]  D.  Gu,  R.  E.  Gander,  and  E.  C.  Crichlow,  "Determination  of  nerve 
conduction  velocity  distribution  from  sampled  compound  action 
potential  signals,"  IEEE  Transactions  on  Biomedical  Engineerings 
vol.  43,  no.  8,  pp.  829-838,  Aug.  1996. 

[10]  Y.  X.  Tu,  A.  Wemsdorfer,  S.  Honda,  and  Y.  Tomita,  "Estimation  of 
Conduction  velocity  distribution  by  regularized-least-squares 
method,"  IEEE  Transactions  on  Biomedical  Engineerings  vol.  44, 
no.  1 1 ,  pp.  1102-11 06,  Nov.  1 997. 

[11]  R.  B.  Szlavik,  "A  novel  method  for  characterization  of  peripheral 
nerve  fiber  size  distributions  by  group  delay,"  IEEE  Trans.  Bioiued. 
Engs  vol.  55,  no.  12,  pp.  2836-2840,  Dcc.2008. 

[12]  R.  B.  Szlavik  and  G.  E.  Turner,  "A  novel  method  for  characteriziition 
of  peripheral  nerve  fiber  size  distributions  by  group  delay 
measurements  and  simulated  annealing  optimization,"  in  30th 
Annual  International  Conference  of  the  IEEE  Engineering  in 
Medicine  and  Biology^  Society'  2008,  pp.  5008-5014. 

[13]  S.  M.  Fleisher,  M.  Studer,  and  G.  S.  Moschytz,  "Mathematical- 
Model  of  the  Single-Fiber  Action-Potential,"  Medical  Biological 
Engineering  &  Computings  vol.  22,  no.  5,  pp.  433-439,  1984. 


Preprint  submitted  to  31st  Annual  International  IEEE  EMBS  Conference. 

Received  April  7,  2009. 


30th  Annual  International  IEEE  EMBS  Conference 
Vancouver,  British  Columbia,  Canada,  August  20-24,  2008 


A  Novel  Method  for  Characterization  of  Peripheral  Nerve  Fiber  Size 
Distributions  by  Group  Delay  Measurements  and  Simulated 

Annealing  Optimization 

Robert  B.  Szlavik  and  Galen  E.  Turner  III 


Abstract — The  ability  to  determine  the  characteristics  of 
peripheral  nerve  fiber  size  distributions  would  provide 
additional  information  to  clinicians  for  the  diagnosis  of  specific 
pathologies  of  the  peripheral  nervous  system.  Investigation  of 
these  conditions,  using  electro-diagnostic  techniques,  is 
advantageous  in  the  sense  that  such  techniques  tend  to  be 
minimally  invasive  yet  provide  valuable  diagnostic  information. 
One  of  the  principal  electro-diagnostic  tools  available  to  the 
clinician  is  the  nerve  conduction  velocity  test.  While  the 
peripheral  nerve  conduction  velocity  test  can  provide  useful 
information  to  the  clinician  regarding  the  viability  of  the  nerve 
under  study,  it  is  a  single  parameter  test  that  yields  no  detailed 
information  about  the  characteristics  of  the  functioning  nerve 
fibers  within  the  nerve  trunk.  In  this  study  we  present  a 
technique  based  on  a  decomposition  of  the  maximal  compound 
evoked  potential  and  subsequent  determination  of  the  group 
delay  of  the  contributing  nerve  fibers.  The  fiber  group  delay  is 
then  utilized  as  an  initial  estimation  of  the  nerve  fiber  size 
distribution  and  the  concomitant  temporal  propagation  delays 
of  the  associated  single  fiber  evoked  potentials  to  a  reference 
electrode.  Subsequently  the  estimated  single  fiber  evoked 
potentials  are  optimized  against  the  template  maximal 
compound  evoked  potential  using  a  simulated  annealing 
algorithm.  Simulation  studies,  based  on  deterministic  single 
fiber  action  potential  functions,  are  used  to  demonstrate  the 
robustness  of  the  proposed  technique  in  the  presence  of  noise 
associated  with  variations  in  distance  between  the  nerve  fibers 
and  the  recording  electrodes  between  the  two  recording  sites. 

1.  INTRODUCTION 

he  nerve  conduction  velocity  test  provides  clinically 
useful  information  in  the  diagnosis  of  peripheral 
neuropathies,  such  as  Carpal  Tunnel  Syndrome  [1;2]. 
Since  nerve  conduction  velocity  studies  are  essentially  single 
parameter  measurements  of  the  gross  conduction  properties 
of  the  underlying  nerve  trunk,  such  studies  are  not  suited  to 
providing  detailed  information  regarding  the  characteristics 
of  the  underlying  nerve  fibers  that  contribute  to  the 
compound  evoked  potential. 

A  more  robust  measurement  technique  would  involve  the 
ability  to  extract  information  about  the  viability  of  the 
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underlying  nerve  fibers  which  could  potentially  provide 
useful  information  to  the  clinician.  As  an  example, 
information  related  to  the  size  distribution  of  contributing 
nerve  fibers  can  be  used  to  differentiate  between  different 
clinical  conditions  such  as  Chronic  Inflammatory 
Demyelinating  Polyneuropathy,  which  selectively  impacts 
larger  nerve  fibers,  or  Early  Diabetic  Peripheral  Neuropathy, 
which  impacts  smaller  fibers  [3;4]. 

There  is  a  large  body  of  literature  devoted  to  describing 
various  techniques  for  determining  the  nerve  fiber 
conduction  velocity  distribution  (CVD).  The  pioneering 
work  of  Cummins  and  Dorfman  [5;6]  describe  techniques 
that  use  two  compound  action  potentials  to  estimate  the 
conduction  velocity  distribution  using  a  least  squares 
approach.  Common  to  these  studies  was  the  assumption  that 
fibers  included  in  a  specific  velocity  class  have  identical 
evoked  potential  waveforms. 

More  recently  there  have  been  several  additional  studies 
including  the  work  of  Gonzalez-Cueto,  Papadopoulou  and 
Gu  [7-9].  The  study  presented  by  Tu  et.  al.  focused  on  a 
regularized  least  squares  algorithm  but  features  many  of  the 
same  assumptions  associated  with  waveform  commonality 
related  to  velocity  classes  that  were  made  in  earlier  work 
[10].  This  study  also  investigated  the  impact  of  noise  on  the 
integrity  of  the  estimated  CVD. 

In  this  paper,  we  discuss  a  novel  technique,  presented 
previously  by  the  author  [11],  for  estimating  the  size 
distribution  of  contributing  nerve  fibers  which  is  linearly 
related  to  the  CVD.  The  technique  is  based  on  an  estimation 
of  the  group  delay  between  two  sets  of  recording  electrodes 
associated  with  the  individual  fibers  that  contribute  to  a 
maximal  compound  evoked  potential.  The  group  delay 
information  is  then  used  to  estimate  the  diameters  of  the 
activated  fibers  as  well  as  the  propagation  delays  of 
individual  single  fiber  evoked  potentials  to  a  reference 
electrode.  This  process  allows  for  reconstruction  of  an 
estimated  maximal  compound  evoked  potential,  from  the 
individual  single  fiber  evoked  potentials,  at  the  first 
recording  site.  The  previously  presented  group  delay 
technique  is  expanded  upon  in  this  paper  by  introduction  of 
a  simulated  annealing  optimization  algorithm.  This 
algorithm  is  used  to  vary  the  diameter  and  concomitant 
propagation  delays  associated  with  the  estimated  single  fiber 
evoked  potential  waveforms  to  search  for  an  improved  fit 
with  the  template  maximal  compound  evoked  potential  from 
the  same  recording  site. 

The  basic  methodology  behind  the  technique  is  presented 
by  utilizing  a  closed  form  mathematical  model  of  a  single 
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fiber  evoked  potential  waveform  that  allows  us  to 
demonstrate  the  robustness  of  the  technique  under  noisy 
conditions  introduced  by  random  variations  in  the 
perpendicular  distance  between  the  fiber  and  recording 
electrode  1 12]. 


11.  METHOD 

The  simulation  for  determination  of  the  group  delay  is 
premised  on  the  physical  setup  shown  in  Figure  1,  where  a 
stimulator  is  used  to  excite  a  subcutaneous  nerve  trunk 
consisting  of  a  group  of  electrically  independent  nerve 
fibers.  The  propagating  compound  evoked  potential  is 
detected  at  two  recording  sites.  Using  a  series  of 
successively  increasing  current  stimulus  pulses,  the 
successively  recorded  compound  evoked  potentials  ean  be 
decomposed  into  their  constituent  single  fiber  action 
potentials  in  a  manner  analogous  to  the  protocol  used  in  the 
McComas  et  al  motor  unit  number  estimation  technique 
113). 


X' —  X 


The  parameters  shown  in  Tabic  1  were  used  in  the 
distribution  of  (1). 

TABLE  I 


Parameter  values  used  in  the  fiber  diameter  distribution 


Symbol 

Quantity 

Value 

Ih 

complete  distribution  f  mode  scaling  const. 

0.05  (m) 

Oi 

complete  distribution  1 mode  std.  dev. 

0.1274  (pm) 

complete  distribution  1  '*  mode  mean 

0.5  (pm) 

P: 

complete  distribution  2"**  mode  scaling  const 

0.25  (m) 

CT? 

complete  distribution  2"**  mode  std.  dev. 

0.8493  (pm) 

^2 

complete  distribution  2"*^  mode  mean 

3  (pm) 

/h 

complete  distribution  3"*^  mode  scaling  const. 

0.3  (m) 

rr.i 

complete  distribution  3'*^  mode  std.  dev. 

1 .699  (pm) 

complete  di.stribution  3"‘‘  mode  mean 

7.5  (pm) 

complete  distribution  4'*’  mtxle  scaling  const. 

0.4  (m) 

04 

complete  distribution  4'*’  mtxie  std.  dev. 

1.699  (pni) 

complete  distribution  4‘^  mcxle  mean 

13  (pm) 

Fiber  diameters  less  than  5  pm  were  excluded  from  the 
population  yielding  a  sub-population  of  m  =  60  fibers.  The 
maximum  nerve  fiber  diameter  in  the  distribution  was  17.1 
pm.  This  randomly  generated  fiber  diameter  distribution 
formed  the  template  distribution  population  d. 

The  population  of  nerve  fibers  was  subjected  to  a  series  of 
virtual  stimulus  pulses  of  successively  increasing  current 
amplitude  where  Hi  is  the  amplitude  of  the  stimulus  current 
pulse  at  each  increment  /.  An  activation  function  f(d)  is 
used  to  determine  whether  a  given  stimulus  current 
amplitude  was  sufficient  to  excite  each  fiber  with  diameter  d 
as  per  (2)  where  ^  =  10  mA  and  r]  =  3.5  x  10^  m“^. 

f(d)  =  <exp[-7/d]  (2) 

For  each  recording  site  n  =  1,2,  the  compound  evoked 
potential  is  computed  for  each  increment  /  of  the 

stimulus  current  amplitude  as  per  (3). 


Figure  1.  Conceptual  physical  configuration  of  the  proposed  methcxl.  The 
diagram  shows  the  stimulus  and  recording  sites  as  well  as  the  relationship 

between  the  individual  single  fiber  evoked  potentials  sets  and 

to  the  maximal  compound  evoked  potentials  and 

The  figure  is  not  drawn  to  scale  and  is  indicative  of  stimulation 
and  recording  sites  at  convenient  locations  along  the  median  nerve.  From 
an  experimental  perspective,  implementation  could  involve  stimulation  of 
the  median  nerve  at  the  anterior  cubital  fossa  with  recording  sites  placed 
more  distally  at  anatomically  convenient  locations  such  as  the  wrist.  This 
type  of  placement  would  result  in  distances  that  are  larger  than  those 
indicated  on  the  figure. 


An  empirically  determined  nerve  fiber  diameter 
distribution  [M]  was  used  to  generate  a  random  population 
of  one  hundred  nerve  fiber  diameters  using  a  technique 
described  by  Szlavik  and  de  Bruin  [15].  The  distribution  in 
( 1 )  was  used  to  generate  the  fiber  diameter  population. 


Pd(dk) = y 


exp 


idk  -iihY 


2al 


(1) 


m 

-f(dfe)]G[vfc  •  (t  (3) 

k  =  l 

In  (3),  the  single  fiber  action  potential  waveform  ^[i;^  • 
(t  —  contributes  to  the  compound  evoked  potential 

if  the  argument  of  the  step  function  u  is  positive  where  t  is 
the  time  in  seconds,  is  the  conduction  velocity  of  the 
fiber,  is  the  propagation  delay,  in  seconds,  of  the  single 
fiber  action  potential  from  the  stimulus  site  to  the 
recording  site  and  f  is  the  perpendicular  depth  between  the 
recording  site  and  the  center  of  the  fiber. 

The  function  G  is  the  normalized  model  of  the  single  fiber 
action  potential  proposed  by  Fleisher  et.  al.  where  the 
function  has  been  normalized  to  the  current  through  the 
second  pole  such  that  G  —  gjl  as  per  (4).  All  other 
parameters  are  as  described  in  Fleisher  [12]  and  were 
assigned  values  =  d^/2.  5^  =  5  •  a^,  f  =  1  mm, 

=  a  =  0.75,  (7^  =  1.0  5/m  and  = 

(afc  +  Sfc)/(f +  Sfc). 
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After  the  compound  evoked  potentials  are  computed  for 
each  virtual  current  step  Hi,  the  series  of  compound  evoked 
potentials  at  each  recording  site  and  are 

decomposed  into  a  series  of  waveforms  that  nominally 
consist  of  the  contributing  single  fiber  action  potentials  at 
each  simulated  current  step  and  as  per  (5). 

r|"{(£:)  =  for  2  <  i  <  q  +  1  (5) 

If  the  current  steps  are  small  enough,  then  the  waveforms 
will  consist  of  individual  contributing  single  fiber 
action  potentials  or  no  waveform  where  a  stimulus  current 
increment  does  not  result  in  an  additional  recruited  fiber. 
However,  a  perfect  decomposition  will  not  always  be 
achievable  due  to  the  finite  discretization  of  the  stimulus 
current  steps.  Some  of  the  q  non-zero  waveforms  in  the  set 
will  consist  of  more  than  one  single  fiber  action 
potential. 

Once  the  decomposition  is  complete,  the  individual 
decomposed  waveforms  from  the  two  recording  sites  can  be 
used  to  compute  an  estimate  of  the  group  delay  associated 
with  each  contributing  nerve  fiber  where  the  frequency 
response  of  a  given  fiber  ///-iC/)  is  as  shown  in  (6). 


g[r|-Ut)] 

g[r|iU0] 


(6) 


facilitates  the  computation  of  the  associated  group  delay 
Tj.j.  The  estimated  group  delays  for  the  contributing  nerve 
fibers  are  used  to  compute  an  estimate  of  the  associated  fiber 
diameters  from  (8)  where  /  (?n)  is  the  distance  between  the 
two  recording  sites  and  c  =  3.0x10^  s'^. 


Once  the  estimated  group  delay  is  computed  for  each  non¬ 
zero  pair  of  decomposed  waveforms  and  an 

estimate  of  the  sequence  of  nerve  fiber  diameters  d  is 
obtained  for  the  contributing  fiber  population. 

The  overall  process  described  above  is  illustrated  in  the 
flowchart  of  Figure  2. 


The  frequency  response  is  computed  by  dividing  the 
Fourier  Transform  of  the  single  fiber  evoked  potential 
associated  with  the  more  distal  recording  site  by  the  Fourier 
Transform  of  the  single  fiber  evoked  potential  associated 
with  the  more  proximal  recording  site.  Since  each 

estimate  of  the  group 
delay  for  each  pair  of  non-zero  decomp>osed  waveforms 

and  can  be  computed  from  (7). 

1  (7) 

2n  df 

In  practice,  a  least  squares  line  is  fitted  to  the  phase 
response  Oi-i(f)  for  the  computed  for  each  pair  of 

non-zero  decomposed  waveforms  and  which 


Figure  2.  Flowchart  of  algorithm  implemented  to  calculate  an  estimate  of 
the  group  delay  of  the  contributing  population  of  nerve  fibers  and  the 
estimated  fiber  diameter  set  d.  The  technique  is  based  on  determination  of 
an  estimate  of  the  group  delay  associated  with  each  non-zero  decomposed 
waveform  r^^Ct)  and 

Random  variations,  from  the  first  recording  site  to  the 
second,  in  the  perpendicular  distance  between  the  recording 
site  and  the  center  of  the  nerve  fiber  r  could  reasonably  be 
expected.  This  characteristic  would  result  in  random 
variations  in  the  form  of  the  contributing  single  fiber  action 

potentials  •  (t  —  associated  with  each  specific 

fiber.  To  simulate  the  impact  of  this  noise  source  on  the 
system,  r  is  replaced  with  a  normally  distributed  random 
number  with  a  standard  deviation  of  Pi^  and  a  mean  of  f. 
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Figure  3.  Flowchart  of  the  simulated  annealing  algorithm  that  computes  an 
improved  estimate  of  the  nerve  fiber  diameter  population  set  d  from  the 
group  delay  estimated  population  set  d. 

The  simulated  annealing  algorithm,  first  proposed  by 
Metropolis  et.  ol.  [16],  can  be  used  to  compute  solutions  to 
NP-complete  problems  such  as  the  traveling  salesman 
problem,  where  these  solutions  are  optimal  or  very  close  to 
optimal  [17;  18].  The  problem  of  determining  the  correct 
diameters  of  the  contributing  nerve  fiber  population  and 
concomitant  forms  for  each  of  the  single  fiber  evoked 
potentials,  is  also  an  NP-complete  problem  to  which  the 
simulated  annealing  algorithm  may  be  applied.  The 
optimized  contributing  fiber  diameter  set  is  a  set  of 
diameters  d  such  that  (9)  is  true. 

The  waveform  is  the  first  recording  site  template 

evoked  potential  at  the  maximum  stimulus  current  pulse 
amplitude  such  that  i  =  p  and  is  the  maximal 

compound  evoked  potential  estimated  from  the  group  delay 
decomposition  at  the  first  recording  site  as  per  (10)  and 
optimized  using  the  simulated  annealing  algorithm.  In  (10), 
q  is  the  number  of  non-zero  single  fiber  evoked  potential 
waveforms  obtained  through  the  decomposition  shown  in  (4) 

and  are  the  decomposed  fiber  evoked  potential 

waveforms  at  the  first  recording  site. 

ip(i)(t)  =  ^  (10) 

>=1 

The  algorithm  to  compute  the  estimated  set  of  nerve  fiber 
diameters  d  from  simulated  annealing  is  illustrated  in  the 
flowchart  of  Figure  3. 


The  first  step  is  to  compute  the  group  delay  estimated  set 
of  contributing  single  fiber  action  potential  waveforms 
and  then  to  compute  from  (10).  The  error 

between  the  template  maximal  compound  evoked  potential 
and  the  group  delay  estimated  compound  evoked 
potential  with  all  fibers  contributing  is  computed. 

This  error  A  is  formulated  in  terms  of  the  two-norm 
difference  between  the  two  waveforms. 


A=||4^(i)(0  -  (11) 


The  simulated  annealing  algorithm  initially  determines 
whether  the  A  <  Aivun  or  if  the  annealing  temperature 
^  T'miN'  If  either  of  these  inequalities  hold,  the  algorithm 
exits  and  the  optimized  set  of  fiber  diameters  d  is  set  equal 
to  the  set  d.  In  the  event  neither  inequality  holds,  an 
estimated  fiber  diameter  dj  is  randomly  chosen  from  the  set 
d  and  a  new  fiber  diameter  for  this  specific  fiber  is  selected 
at  random  such  that  dj  =  dj.  The  concomitant  single  fiber 
evoked  potential  waveform  for  the  randomly  generated  fiber 
diameter  is  computed  at  the  first  recording  site  using 


(4).  With  this  new  randomly  generated  single  fiber  action 
potential,  a  new  value  is  computed  for  the  estimated 
compound  evoked  potential  associated  with  the  contribution 
of  all  fibers  in  the  population  Equation  (11)  is 

invoked  to  compute  a  new  error  estimate  A^ew  ^new 
A  or  if  the  simulated  annealing  inequality  in  (12)  holds, 
where  Y  is  a  uniformly  distributed  random  number  between 
zero  and  unity,  the  new  randomly  generated  fiber  diameter  is 
accepted. 


Y  <  exp 


1^  ~  ^NEwl 

f 


(12) 


If  neither  of  these  inequalities  hold,  the  newly  generated 
random  fiber  diameter  dj  is  rejected  and  replaced  with  the 
old  fiber  diameter  dj.  This  process  is  repeated  for  the 
number  of  trials  allowed  per  annealing  step.  Once  the 
number  of  trials  is  exceeded,  the  annealing  temperature  T  is 
reduced  and  the  entire  process  is  repeated  for  the  number  of 
trials  allowed  per  annealing  step.  The  simulated  annealing 
algorithm  exits  once  either  T  <  or  A  <  Aj^hn.  The 
output  of  the  algorithm  is  the  annealed  estimate  of  the  fiber 
diameter  set  d. 


111.  RESULTS 

A  population  of  100  randomly  generated  fibers  was 
utilized  in  these  studies.  Fibers  with  diameters  less  than  5 
pm  were  rejected  yielding  a  subpopulation  of  m  =  60  fibers 
with  a  maximum  diameter  of  17.1  pm.  These  fibers  were 
subjected  to  a  virtual  stimulus  pulse  train  of  successively 
increasing  amplitudes  ranging  from  zero  to  a  maximum  of  1 
mA  in  500  nA  steps.  At  each  step  the  compound  evoked 
potential  at  both  virtual  recording  sites  was  computed  as  per 
(3)  and  subsequently,  the  estimate  of  single  fiber  action 
potential  waveforms  were  obtained  at  each  recording  site  as 
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per  (5).  The  concomitant  group  delays  between  the  two 
virtual  recording  sites  were  computed  yielding  the  group 
delay  estimated  set  of  fiber  diameters  d. 

A  histogram  comparing  the  actual  template  fiber 
population  d  to  the  group  delay  estimated  population  d  is 
shown  in  Figure  4. 


Fiber  Diameter  (fim) 


Figure  4.  Histogram  of  template  nerve  fiber  size  population  d  and  group 
delay  estimated  nerve  fiber  size  population  d.  The  simulation  was  carried 
out  with  an  SNR  of  20  dB  with  respect  to  random  variations  in  the 
perpendicular  distance  between  the  nerve  fiber  and  the  recording  site.  Chi 
Square  Test  results  for  the  two  distributions  yielded  Q(x^\x)  =  0.7101. 


diameter  population  d  to  the  optimized  diameter  population 
d  is  shown  in  Figure  5. 

Figure  6  compares  the  maximal  template  compound 
evoked  potential  at  the  ftrst  electrode  with  the 

maximal  group  delay  estimated  compound  evoked  potential 
and  the  maximal  annealed  compound  evoked 
potential  for  the  distributions  shown  in  Figures  4 

and  5. 
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Figure  5.  Histogram  of  the  template  nerve  fiber  size  population  d  and 
annealed  nerve  fiber  size  population  d  from  the  group  delay  estimated 
distribution  d  shown  in  Figure  4.  The  simulation  was  carried  out  with  an 
SNR  of  20  dB  with  respect  to  random  variations  in  the  perpendicular 
distance  between  the  nerve  fiber  and  the  recording  site.  Chi  Square  Test 
results  for  the  two  distributions  yielded  Q{jc^\x)  =  0.9912. 

The  estimated  fiber  diameter  population  d  was  then 
optimized  using  the  simulated  annealing  algorithm  described 
earlier.  An  initial  annealing  temperature  of  T  =  10  was 
used  with  an  annealing  step  factor  of  0.9.  The  minimum 
annealing  temperature  was  =  1  X  10“^  with  a 

minimum  error  bound  =  1.  The  maximum  number  of 
trials  for  each  annealing  temperature  step  was  limited  to 
1000.  A  histogram  comparing  the  actual  template  fiber 


Figure  6.  Graphs  comparing  the  template  maximal  compound  evoked 
potential  to  the  group  delay  estimated  maximal  compound  evoked  potential 
and  the  annealed  maximal  compound  evoked  potential.  The  graph  on  the 
top  shows  the  template  maximal  compound  evoked  potential  at  the  first 
recording  site  and  the  group  delay  estimated  maximal  compound 

evoked  potential  at  the  first  recording  site  A  comparison  of 

to  the  annealed  maximal  compound  evoked  potential  that 

results  from  optimization  of  the  group  delay  estimate  with  the  simulated 
annealing  algorithm  is  shown  in  the  graph  on  the  bottom.  The  normalized 
final  error  between  and  as  per  (13),  is  FE  =  7.673%. 

The  effect  of  noise  variations  in  the  distance  between  the 
individual  nerve  fibers  at  the  two  virtual  recording  sites  was 
also  studied.  Table  2  consists  of  typical  Chi  Squared  Test 
results  comparing  the  optimized  and  template  histograms 
over  a  range  of  SNR  values  where  the  signal  value  is  taken 
as  the  mean  distance  f  and  the  noise  power  is  the  variance 
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in  the  normally  distributed  distance  variation  around  the 
mean  value. 


SNR 

(dB) 

Group  Delay 
and  Template 
Distribution 
Qix^U) 

Annealed  and 
Template 
Distribution 

Annealed 

and 

Template 
Transient 
Final  Error 
FE(%) 

0 

0.3958 

0.7235 

20.93 

20 

0.7101 

0.99 1 2 

7,673 

40 

0.7753 

0.8850 

10.54 

Table  2.  Chi  Square  Test  results  and  final  normalized  error  FE  for 
different  values  of  SNR  associated  with  normally  distributed  random 
variations  in  the  perpendicular  distance  belwcen  the  recording  eleclrode 
site  and  the  concomilanl  nerve  fiber. 


The  final  error  in  percent,  as  shown  in  Table  2,  was 
calculated  as  per  { 13). 


FE  = 


/||vf;Ci)(£)_vp(i)(£)||  \ 
[  ) 


100% 


(13) 


IV.  DISCUSSION 

The  results  of  the  simulation  study  shown  earlier 
demonstrate  that  the  technique  presented  herein  can,  with 
reasonable  accuracy,  retrieve  the  conduction  velocity 
distribution  in  the  presence  of  noise  introduced  through 
variations  in  the  perpendicular  distance  between  the 
recording  site  and  the  contributing  fiber.  The  algorithm  is 
effective  even  in  reasonably  high  noise  situations  where  the 
SNR  associated  with  variations  in  the  nerve  fiber  depth  is  0 
dB.  In  the  0  dB  case,  a  Chi  Square  Test  comparing  the 
actual  template  nerve  fiber  size  distribution  d  with  the 
distribution  obtained  from  the  group  delay  extraction  d 
yields  a  result  of  0.3958.  After  application  of  the  simulated 
annealing  algorithm  to  yield  the  optimized  distribution  d,  a 
Chi  Square  Test  comparing  the  optimized  distribution  to  the 
actual  template  distribution  d  yielded  a  higher  value  of 
0.7235  which  suggests  that  the  annealed  diameter  set  and  the 
template  set  are  more  consistent  with  a  single  distribution 
than  the  template  set  and  the  group  delay  set.  Similar  results 
were  given  in  Table  2,  for  higher  SNR  values  associated 
with  variation  in  the  perpendicular  nerve  fiber  and  recording 
.site  distance. 

The  graphs  shown  in  Figure  6  further  demonstrate  the 
ability  of  the  simulated  annealing  optimization  approach  to 
improve  upon  the  maximal  compound  evoked  potential 
estimated  using  the  group  delay  extracted 
population  d  as  compared  to  the  template  maximal 
compound  evoked  potential  After  application  of 

the  simulated  annealing  algorithm,  the  bottom  graph  in 
Figure  6  demonstrates  a  reasonable  convergence  between  the 
template  maximal  compound  evoked  potential  and 

the  maximal  compound  evoked  potential  associated 


with  the  optimized  fiber  diameter  population  d.  Thi.s 
convergence  is  further  demonstrated  by  the  relatively  low 
normalized  final  error  of  7.673%. 

Since  the  optimization  prcKess  is  random  in  nature,  a 
successive  decrease  in  the  normalized  final  error  is  not 
always  observed  with  increasing  SNR  values  as 
demonstrated  between  the  20  dB  and  40  dB  data  shown  in 
Table  2.  The  increase  in  the  normalized  final  error  from  the 
20  dB  to  the  40  dB  case  is  consistent  with  a  lower  value  of 
the  Chi  Square  Test  comparing  the  template  distribution  to 
the  annealed  distribution  for  an  SNR  value  of  40  dB  than  for 
the  20  dB  case. 

The  proposed  technique  for  measuring  the  size 
distribution  of  nerve  fibers  that  contribute  to  the  maximal 
compound  evoked  potential  has  several  advantages  over 
other  earlier  proposed  methods.  Unlike  some  previous 
techniques  [5;  10],  no  inherent  assumptions  are  made 
regarding  size  based  classification  of  contributing  single 
fiber  evoked  potentials.  Each  contributing  single  fiber 
evoked  potential  can,  in  theory,  have  a  unique  wave  shape. 
The  fact  that  many  of  the  other  techniques  stipulate  specific 
forms  of  the  single  fiber  action  potential  waveforms  based 
upon  dividing  the  range  of  fiber  diameters  into  distinct 
groups,  makes  direct  comparison  of  these  techniques 
problematic. 

One  of  the  disadvantages  of  the  proposed  approach,  in 
comparison  to  other  techniques  is  the  necessity  to  perform  a 
series  of  compound  evoked  potential  measurements 
associated  with  a  train  of  successively  increasing  stimulus 
current  pulse  amplitudes.  While  the  measurement  associated 
with  the  proposed  method  is  more  involved,  the  protocols 
for  extracting  individual  contributing  evoked  potentials 
based  upon  a  successively  increasing  stimulus  pulse 
amplitude  is  well  established  in  the  literature  on  motor  unit 
number  estimation  [13]. 
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Implementation  of  Improved  Physiologic  Components  in  an  In  Vitro  Tissue  Engineered 
Blood  Vessel  Mimic  for  Stent  Evaluation 


Dimitri  E.  Delagrammaticas\  Mare  C.  Dawson',  and  Kristen  Q.  Cardinal' 
'Cal  Poly,  San  Luis  Obispo,  California,  USA 


Introduction 

Due  to  the  rapid  emergence  of  minimally-invasivc 
intravascular  technologies  for  treating  and  diagnosing 
cardiovascular  disease,  the  need  exists  for  relevant 
prcelinieal  models  to  evaluate  these  new  devices.  Tissue 
engineered  blood  vessels  have  the  potential  to  meet  such  a 
need,  as  these  living  constructs  ean  be  composed  of 
human  vascular  cells  and  cultivated  in  a  controlled 
bioreaetor  environment  to  create  an  in  vitro  model 
system.  Previous  work  has  demonstrated  the  ability  to 
create  and  use  tissue  engineered  blood  vessels  for 
evaluating  cndothclialization  of  intravascular  stents  (1). 
Although  the  previously  developed  vessel  mimic  systems 
have  served  as  an  adequate  model,  several  potential 
limitations  exist,  including  the  use  of  microvascular 
endothelial  eells  and  sub-physiologie  levels  of  shear 
stress.  Therefore,  it  was  hypothesized  that  speeifie 
features  of  the  engineered  construct  eould  be  altered  to 
make  the  model  a  more  representative  vessel  mimic.  The 
objectives  of  the  current  work  were  to  determine 
feasibility  of  implementing  1)  a  large  vessel  endothelial 
cell  source  and  2)  viscous  media  that  would  more  closely 
mimic  shear  stresses  of  an  artery. 

Materials  and  Methods 

Tissue  engineered  blood  vessels  were  developed  using 
4mm  ID  expanded  polytetrafluoroethylenc  scaffolds  as 
described  previously  ( I ).  Scaffolds  were  inserted  into 
bioreaetor  systems  and  were  pressure-sodded  with 
passage  4-5  human  umbilical  vein  endothelial  cells 
(HUVECs).  Luminal  flow  was  maintained  for  up  to  7 
days.  Following  cultivation,  vessels  were  removed  and 
fixed  for  evaluation  by  scanning  electron  microscopy  in 
order  to  assess  luminal  cell  linings.  Increased  shear  stress 
was  implemented  by  selecting  a  media  thickener  to 
increase  viscosity  of  the  circulating  nutrient  media. 
Dextran  and  methyl  cellulose  were  identified  as  potential 
options  (2,  3),  and  were  compared  based  on  the 
concentration  necessary  and  the  dissolvability  in  cell 
culture  media.  Tissue  engineered  vessels  were  created 
and  viscous  media  was  added  to  media  reservoirs  to 
evaluate  use  in  the  vessel  mimie  systems. 

Results 

HUVECs  sodded  at  a  density  of  5  x  10^  eells/em"  formed 
a  luminal  lining  within  vessel  constructs.  The  cellular 
lining  was  sustained  in  vitro  for  up  to  7  days.  Ongoing 
studies  will  elucidate  the  potential  to  sustain  the  vessels 
for  extended  durations  in  vitro  and  the  potential  for  the 
HUVEC  cell  lining  to  withstand  stent  implantation. 


Dextran  was  selected  as  the  preferred  thickening  agent 
due  to  its  ability  to  easily  dissolve  in  our  cell  culture 
media.  Media  containing  8%  dextran  was  selected  due  to 
its  viscosity  and  was  implemented  as  the  circulating 
media  within  blood  vessel  mimie  systems.  Cell  linings 
withstood  circulation  of  this  viscous  media.  Further 
optimization  of  viscosity  for  desired  shear  stress  levels 
and  evaluation  of  the  effects  of  increased  shear  stresses 
are  underway.  Future  research  will  determine  the  impact 
of  increased  shear  stress  on  the  cndothclialization 
response  to  stents  within  this  in  vitro  model  system. 

Discussion  and  Conclusions 
This  work  supports  the  feasibility  of  implementing 
improved  physiologic  conditions  within  an  existing  tissue 
engineered  blood  vessel  mimic  as  a  preclinieal  model  for 
intravascular  device  evaluation.  The  use  of  HUVECs  as  a 
large  vessel  cell  source  and  the  addition  of  a  media 
supplement  for  increased  viscosity  described  in  this  work 
are  significant  for  their  application  to  the  in  vitro  blood 
vessel  mimic  model.  The  use  of  tissue  engineered  blood 
vessels  as  prcelinieal  models  for  device  evaluation  is 
significant  for  both  the  tissue  engineering  field  as  well  as 
the  medical  device  industry. 
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Assigning  Closely  Spaced  Targets  to  Multiple 
Autonomous  Underwater  Vehicles 


Beverley  Chow,  Christopher  Michael  Clark,  Member,  IEEE,  and  Jan  Paul  Huissoon'*' 


Abstract 

This  paper  addresses  the  problem  of  allocating  closely 
spaced  targets  to  multiple  autonomous  underwater  ve¬ 
hicles  in  the  presence  of  constant  ocean  currents. 
The  main  difficultly  of  this  problem  is  that  the  non- 
holonomic  vehicles  are  constrained  to  move  along 
forward  paths  with  bounded  curvatures.  The  pro¬ 
posed  algorithm  solves  the  task  allocation  problem 
with  market-based  auctions  that  minimize  the  total 
travel  time  to  complete  the  mission.  By  considering 
the  dynamics  and  kinematics  of  the  vehicle  as  well 
as  the  effect  of  ocean  currents  within  the  cost  func¬ 
tion,  the  proposed  algorithm  is  able  to  create  feasible 
paths  with  a  lower  cost  when  compared  to  solutions 
whose  cost  functions  are  calculated  based  solely  on 
Euclidean  distances. 

Index  Terms  -  autonomous  underwater  vehicles, 
auction-based  allocation  algorithm,  multi-robot  sys¬ 
tems 


1.  INTRODUCTION 

Autonomous  Underwater  Vehicles  (AUVs)  have 
been  used  successfully  in  the  past  to  solve  geological, 
biological,  chemical,  and  physical  oceanographic  prob¬ 
lems.  This  has  resulted  in  a  variety  of  scientific  and 
commercial  AUVs  to  be  designed,  built,  and  deployed. 
With  the  increasing  feasibility  and  decreasing  expense 
of  AUVs,  interest  in  using  them  for  ocean  sampling, 
mapping,  surveillance,  and  communication  is  growing 
and  multi-AUV  operations  are  beginning  to  be  realized 
in  the  water.  As  with  any  multi-robot  system,  a  chal¬ 
lenge  is  to  determine  which  robot  should  perform  which 
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task  in  order  to  cooperatively  achieve  the  global  goal  in 
an  optimal  manner. 

This  paper  considers  the  allocation  of  m  targets  to 
n  vehicles.  Given  a  set  of  vehicles  {Vj, V2,  and 

targets  D  =  {d\,d2,...,dm},  the  problem  is  to  assign  a 
sequence  of  targets  5,  to  each  vehicle  to  visit  and  a  path 
through  the  sequence  5/.  The  objective  is  to: 

Minimize 

Ctotai  =maxC(5,)  (1) 

/ 

subject  to 


D  =  |_J5/  (disjoint  union) 


dxij  ^ 

=  vocos(v^/,r) 

<^y  i  t  .  /  N 

— —  =  vosin(i///,,)  > 

dt 


dxi/jt 

dt 


re  [-(0,-l-G)] 


(2) 

(3) 


where  vq  denotes  the  nominal  vehicle  speed,  the 
yaw  of  the  vehicle,  and  O)  represents  the  bound  on  the 
yaw  rate.  In  (1),  C(5/)  is  the  time  required  for  Vj  to 
complete  its  tour  5/.  Note  that  (2)  dictates  all  tasks  to  be 
visited  and  restricts  each  task  to  be  assigned  to  only  one 
vehicle  and  (3)  considers  the  non-holonomic  constraints 
of  the  vehicle. 

The  features  that  differentiate  this  research  to  sim¬ 
ilar  problems  previously  studied  are  the  kinematic  con¬ 
straints  on  the  vehicle  and  the  presence  of  a  constant 
ocean  current.  This  paper  addresses  the  inability  of  an 
AUV  to  turn  at  any  arbitrary  yaw  rate  which  becomes  a 
problem  when  target  points  are  close  together.  The  Du- 
bins  model  [1]  is  a  simple  but  efficient  way  to  handle 
the  kinematic  characteristics  of  AUVs.  It  gives  com¬ 
plete  characterization  of  the  optimal  paths  between  two 
configurations  for  a  vehicle  with  limited  turning  radius 
moving  in  a  plane  at  constant  speed. 

In  this  paper,  Dubins  paths  are  modified  to  include 
ocean  currents,  resulting  in  paths  defined  by  curves 
whose  radius  of  curvature  is  not  constant.  To  determine 


the  time  required  to  follow  such  paths,  an  approximate 
dynamic  model  of  the  AUV  is  queried.  Specifically,  a 
lower  order  model  of  the  REMUS  AUV  model  from  [2] 
is  used  so  that  the  computational  complexity  is  reduced. 

The  remainder  of  this  paper  is  organized  as  follows: 
In  Section  11,  a  background  of  task  allocation  problems 
is  given  along  with  a  description  of  various  methods 
used  to  solve  it.  In  Section  III,  the  kinematics  and  dy¬ 
namics  of  the  AUV  are  described.  In  Section  IV,  an 
overview  of  the  proposed  algorithm  is  introduced  with 
the  details  presented  in  Section  V.  Section  VI  discusses 
the  re.sults  from  a  simulation  conducted  in  MATLAB 
and  finally,  the  report  concludes  in  Section  VII. 

2.  BACKGROUND 

The  goal  of  the  task  allocation  problem  is  to  have 
robots  visit  all  targets  while  minimizing  the  total  travel 
time  or  distance  of  the  robots.  When  targets  are  known 
before  the  mission,  it  is  possible  to  build  a  schedule  of 
targets  for  each  robot.  Unfortunately,  this  problem  is 
not  straight  forward  because  the  cost  for  a  robot  to  visit 
target  C  depends  on  whether  that  robot  first  visits  target 
A  or  target  B.  This  problem  is  an  instance  of  the  mul¬ 
tiple  traveling  salesperson  problem  (MTSP),  which  has 
been  studied  extensively  in  combinatorial  optimization. 
Even  in  the  restricted  case  of  one  salesperson,  MTSP  is 
strongly  VP-hard  [3]. 

Several  approaches  have  been  applied  to  the  gen¬ 
eral  problem  of  allocating  tasks  between  multiple  robots 
in  a  team;  refer  to  [4]  for  a  survey  of  these.  Heuris¬ 
tic  methods  are  typically  used  since  optimizing  the  per¬ 
formance  is  often  computationally  intractable.  Parker’s 
ALLIANCE  [5]  is  one  of  the  earliest  demonstrations  of 
behaviour-based  architectures  for  task  allocation.  An¬ 
other  frequently  used  method  is  based  on  market  mech¬ 
anisms,  such  as  auctions,  which  have  been  demon¬ 
strated  in  [6]  to  be  fast  and  robust  on  real  robots.  Spe¬ 
cific  work  for  AUVs,  often  called  mission  planning,  in¬ 
clude  the  work  by  Sariel  ct  al.  [7]  and  vehicles  with 
bounded  curvature  are  considered  by  Jeyaraman  et  al. 
[8].  Similar  to  the  mission  planning  problem  is  the  rout¬ 
ing  problem  as  investigated  by  Davis  et  al.  [9]  for  the 
planning  for  underwater  gliders  in  the  presence  of  sig¬ 
nificant  currents.  However,  the  vehicle  dynamics  are 
not  accounted  for  in  their  routing  strategy. 

3.  VEHICLE  MODEL 

3.L  AUV  Equations  of  Motion 

This  paper  uses  the  REMUS  AUV  model  created 
by  Prestero  [2]  and  considers  a  vehicle  moving  at  a 


constant  speed  in  the  plane  that  can  execute  turns  with 
a  bound  on  maximum  curvature.  The  REMUS  is  a 
torpedo- shaped  AUV  with  6- DOF.  The  vehicle  is  pro¬ 
pelled  by  a  thruster  at  its  tail  and  steered  by  two  inde¬ 
pendent  pairs  of  fins  for  pitch  and  yaw  control. 

Let  —  [nj  V/  u’/  Pi  c^j  r/  A/  v/  zi  (Pi  0/  y/y]  de¬ 
note  the  state  of  the  vehicle  Vy  at  time  r.  The  first  six 
terms  in  the  state  vector  describe  the  linear  and  angu¬ 
lar  velocities  of  the  vehicle  relative  to  the  body-fixed 
coordinate  and  the  next  six  terms  describe  the  position 
and  orientation  vector  of  the  vehicle  with  respect  to  the 
earth-fixed  frame.  Similarly,  let  (xj.  vj)  denote  the  po¬ 
sition  of  target  cfj. 

Given  the  complex  and  highly  non-linear  nature  of 
the  problem,  numerical  integration  is  used  to  solve  for 
the  vehicle  position  and  orientation  in  time.  At  each 
time  step  the  vehicle  slate  is  updated  by  the  general 
equation: 

+  l  =f(Xu^  Ult.  Vc.  y\fc)  (4) 

where  Xy.,  is  the  vehicle  state  vector,  (7/./  = 
[5v  dr  Xprop  XpropY  input  vcctor,  \v  and  are 

the  magnitude  and  direction  of  the  ocean  current  re.spcc- 
tively.  For  the  input  vector,  5^  is  the  stem  fin  angle,  5r  is 
the  rudder  fin  angle,  Xprop  is  the  surge  force,  and  Kprop 
is  the  yaw  torque  provided  by  the  propeller. 

The  function  /  in  (4)  uses  the  Euler  method  of  nu¬ 
merical  integration  to  yield  the  new  vehicle  state  at  each 
time  step  as: 

^Xu-Y{Xij^At)  (5) 

where  the  state  vector  derivative  Xj  ,  is  updated  using 
the  model  Xy,,  =/(A'y.,,  L^y.,)  from  [2).  With  the  pres¬ 
ence  of  a  fixed  current,  the  position  of  the  vehicle  rela¬ 
tive  to  the  earth-fixed  frame  is  updated  as  follows: 

(  *V  cos  (v/,.)- A/) 

.V/  =  y'  +  (ivsin(v/<.)A/) 

where  x'j  and  y'j  denotes  the  position  of  the  /'*  vehicle 
after  the  integration  step  given  in  (5).  By  combining 
(5)  and  (6),  the  function  /  in  (4)  is  realized  and  can  be 
used  to  update  the  general  stale  of  each  vehicle.  This 
full  model  is  used  in  evaluating  the  final  tour  times  of 
the  sequences  generated  by  the  proposed  algorithm. 

4.  OVERVIEW  OF  PLANNER 

The  algorithm  can  be  broken  up  into  3  stages. 

4.1.  Clustering 

Given  the  (xj^yj)  po.sitions  of  j  =  task 

points,  the  algorithm  starts  by  creating  n  clusters  of  task 


points,  where  n  is  equal  to  the  number  of  AUVs.  The 
method  used  in  this  paper  is  k-means  [10],  which  parti¬ 
tions  the  m  points  into  n  clusters  by  minimizing  the  to¬ 
tal  intra-cluster  variance,  or  the  squared  error  function. 
Each  of  the  n  clusters  are  assigned  to  a  single  vehicle. 

For  all  /  =  l,2,...,n  clusters,  the  three  task  points 
in  each  cluster  /  that  are  farthest  from  the  centroid  are 
assigned  to  vehicle. 

4.2.  Auctioning 

Once  each  vehicle  has  three  task  points  assigned 
to  it,  the  remaining  m  —  3n  tasks  are  auctioned  via  a  se¬ 
quence  of  first-price  one-round  auctions  similar  to  work 
by  Lagoudakis  et.  al  [  1 1  ].  The  unassigned  tasks  are  first 
ordered  according  to  their  distance  from  the  centroid  of 
all  tasks.  The  greater  the  distance  from  the  centroid, 
the  higher  the  priority  the  task  will  have  in  the  order. 
Following  this  order,  each  task  is  auctioned  off.  Each 
vehicle  /  can  bid  on  the  task  j,  where  the  bid  is  equal 
to  the  cost  of  traveling  a  path  that  consists  of  all  previ¬ 
ously  won  tasks  and  the  current  task  being  auctioned. 
Each  vehicle  considers  the  insertion  of  the  new  task  at 
every  point  in  the  current  sequence  Si  = 
where  /  is  the  number  of  previously  won  tasks  by  vehi¬ 
cle  /.  Each  vehicle  submits  a  bid  as  the  lowest  cost  (i.e. 
time)  to  complete  the  new  tour  as: 

Biidj^Si)  =  m\n  C  (7) 

^  0<A'</  \  ^  / 

The  vehicle  with  the  lowest  Bj  wins  target 
dj  and  updates  its  sequence  of  targets  with  = 
The  calculation  of  C(5j)  is  the 
key  to  this  algorithm’s  ability  to  reduce  cost  and  details 
are  found  in  section  5. 

After  a  task  auction  is  completed,  the  auctioning 
process  continues  with  the  next  round  of  bidding  until 
all  tasks  are  allocated. 

4.3.  Post  Processing 

After  all  tasks  have  been  auctioned  off,  each  robot 
has  a  sequence  of  tasks  to  visit.  Due  to  the  inherent 
shortcomings  of  market-based  auction  mechanisms,  the 
cost  of  going  backwards  through  the  same  sequence  of 
tasks  may  produce  a  lower  cost  value.  A  post  processing 
step  was  added  at  the  end  of  the  algorithm  to  check  for 
the  possibility  that  reversing  the  order  of  the  task  points 
would  produce  a  lower  cost. 

5.  PATH  COST  CALCULATION 

To  determine  the  path  cost  for  bidding  as  described 
above,  the  time  C(S)  for  the  AUV  to  traverse  the  se¬ 


quence  needs  to  be  calculated.  A  combination  of  a  Du- 
bins  model,  an  AUV  dynamic  model,  and  a  model  of 
the  ocean  current  is  required. 

5.1.  Dubins  Path 

In  order  to  calculate  the  time  required  to  travel  be¬ 
tween  two  points,  the  Dubins  shortest  path  problem 
must  first  be  solved.  Dubins’  original  work  derived 
conditions  that  characterize  the  optimal  path  between 
two  points  when  both  initial  and  terminal  orientations 
were  specified  and  his  work  has  been  widely  studied 
in  path  planning  [12].  Dubins’  result  [1]  shows  that, 
given  any  two  points,  the  shortest  path  consists  of  ex¬ 
actly  three  path  segments.  Graphically,  the  algorithm 
starts  by  drawing  two  maximum  curvature  circles  that 
are  tangential  to  the  initial  state  vector  and  two  maxi¬ 
mum  curvature  circles  that  are  tangential  to  the  termi¬ 
nal  state  vector.  Dubins’  result  indicates  that  the  op¬ 
timal  trajectory  selects  an  arc  on  one  of  the  two  initial 
circles,  and  connects  tangentially  to  an  arc  on  one  of  the 
two  terminal  circles.  If  the  separation  between  the  ini¬ 
tial  and  end  points  is  sufficient,  this  can  only  be  accom¬ 
plished  by  a  line  segment.  There  are  at  most  four  such 
line  segments,  and  computation  of  the  travel  distances  is 
straightforward,  as  shown  in  Fig.  1  for  two  waypoints 
with  initial  and  terminal  orientations,  denoted  ^nd 
cUjt+i  respectively. 


(a)  (b)  (c)  (d)  (c) 


Figure  1.  (a)  Two  waypoints  and 

{xk+i,yk+i)  with  Uk  =  f  and  (bHe) 

Four  ways  of  connecting  two  waypoints  using 
Dubins  curves. 


In  the  task  allocation  problem,  optimal  values 
for  aic  and  ajt+i  must  be  determined.  In  this  algo¬ 
rithm,  ajt  ^nd  ajt+i  h^ve  been  constrained  to  A  = 
{A;r/4  |  A  =0,...,7}.  With  8  possibilities  for  and 
afc^i  and  4  ways  of  connecting  them,  a  total  of  8  x  8  x 
4  =  256  paths  are  possible  for  every  pair  of  waypoints, 
with  one  of  them  being  the  optimal  path.  As  shown  in 
Fig  2,  different  values  for  ajt  and  ajt4  i  yield  different 
costs. 

The  cost  of  traversing  the  sequence  S  can  then  be 


Figure  2.  Multiple  trajectories  for  different  ini¬ 
tial  and  final  orientations,  (a)  a*  =  a^+i  =  ^ 
(b)  a*  =  =^,  a^M-i  =  n:  (c)  a*  =  =^,  a*+i  = 

calculated  as: 

/ 

r(5)=  min  (8) 

(a,..  ..a/)€A^ 


5.2.  Ocean  Currents 


Figure  4.  Illustration  of  the  iterative  process 
used  to  find  a  tangent  to  two  curves 


In  the  presence  of  ocean  currents,  the  shortest  path 
between  two  points  given  and  consists  of  arcs 
that  are  no  longer  circular  but  elliptic.  These  ellipses 
will  have  different  curvatures  dej^ending  on  the  magni¬ 
tude  and  direction  of  the  current  [Fig.  3]. 


Figure  3.  Dubins  Curves  between  two  way- 
points  with  ocean  currents  vv  =  0.25  m/s  (a) 
V'.-O.  (b)  Wc  =  f.  (c)  Wc  =  and  (d)  Wc==f- 


lower  order  model  /  is  created  based  on  the  full  model 
/  from  (4)  as: 

A/ ( )-.  (.V;t  f  i  -CCa  M ^  f  I ,  ttA ,  + 1 ,  \'() ,  v,.,  t/A,.] 

(9) 

For  arcs,  the  lower  order  model  is  a  piecew  ise  lin¬ 
ear  function  built  from  sampling  the  full  model.  Us¬ 
ing  the  full  model,  the  vehicle  orientation  can  be  de¬ 
termined  at  a  certain  time  /.  In  order  to  find  the  time 
required  to  obtain  a  specific  heading,  linearly  interpo¬ 
lation  is  used  on  the  data  obtained  from  the  full  model 
at  various  fractions  of  a  complete  circumnavigation  of 

the  ellipse  (rjn/S  for  rj  =  0 . 15).  For  straight  line 

segments,  the  current  vector  is  broken  up  into  its  com¬ 
ponents  relative  to  the  body-fixed  frame  and  is  added  to 
the  vehicle's  velocity  vector  to  determine  the  time  re¬ 
quired. 


Finding  a  line  segment  tangent  to  two  curves  is 
solved  by  using  an  iterative  process.  As  a  starting  point, 
the  slope  of  the  tangent  line  to  two  circular  arcs  of  mini¬ 
mum  radius  is  calculated  (Fig.  4a).  Using  that  value.  Pa 
and  Pfj  arc  found  on  the  respective  ellipses  whose  slope 
is  equal  to  the  slope  of  the  tangent  (Fig.  4b).  The  slope 
of  the  line  segment  from  Pa  to  Pfy  is  calculated  and  be¬ 
comes  the  new  slope  for  the  next  iteration  (Fig.  4c).  The 
process  continues  until  convergence  (Fig.  4d). 

5.3.  Path  Time  Calculation 

To  calculate  the  time  required  to  follow  arcs  and 
line  segments  of  the  path,  the  AUV  dynamics  and  ocean 
currents  must  be  considered.  However,  due  to  the  com¬ 
plexity  of  a  full  dynamic  model,  it  is  not  possible  to 
query  it  in  a  reasonable  amount  of  time.  Therefore,  a 


6.  SIMULATION  RESULTS 

This  section  analyzes  the  results  from  a  simulation 
conducted  in  MATLAB.  To  illustrate  the  performance 
of  the  proposed  algorithm,  computer  simulations  were 
carried  out  with  a  model  of  the  REMUS  AUV.  The 
reader  is  referred  to  [2]  for  complete  details,  including 
a  list  of  the  AUV  hydrodynamic  parameters. 

Simulations  were  conducted  for  20  task  points  with 
3  AUVs.  The  task  points  were  generated  randomly 
and  uniformly  inside  a  square  with  side  lengths  of  22 
meters.  The  task  points  were  generated  close  together 
to  highlight  the  necessity  for  considering  the  curvature 
constraints. 

As  a  baseline  for  comparison,  the  “alternating  al¬ 
gorithm”  described  by  Savla  et  al.  [13]  is  used  for  the 
creation  of  Dubins  TSP  tours  (i.e.  sequences  from  ap- 


Table  1.  Simulation  Results  for  ten  randomly 
generated  datasets. 


No  current 

With  current 

Alternating 

Proposed 

Alternating 

Proposed 

Algorithm 

Algorithm 

Algorithm 

Algorithm 

'I'max 

164.1 

75.4 

21 1.3 

77.6 

Tavg 

141.5 

71.1 

176.8 

72.5 

plying  Dubins’  model).  It  works  as  follows:  given  a 
set  of  n  points,  the  optimal  Euclidean  MTSP  tours  (i.e. 
that  do  not  consider  path  curvature)  are  computed  using 
auctions  (Fig.  5).  Then,  it  is  necessary  to  obtain  a  feasi¬ 
ble  path  through  these  ordered  points  using  the  method 
in  [1 3]  which  includes  the  curvature  constraints  of  the 
vehicle. 


-S  0  5  10  is  20  J5 

Figure  5.  Euclidean  MTSP  solution  for  allocat¬ 
ing  20  tasks  to  3  robots 


6.1.  Discussion 

The  results  from  running  the  simulation  on  ten  dif¬ 
ferent  datasets  are  summarized  in  Table  1 ,  where 

Tmax  =  maxCsirniSi)  and  T^vg  = 

Csim  is  the  cost  calculated  by  running  the  planned  tours 
Si  through  the  full  dynamic  model  in  (4).  On  average, 
the  proposed  algorithm  reduced  Tmax  by  54%  over  the 
“alternating  algorithm”  in  the  absense  of  currents  and 
63%  with  the  presence  of  currents. 

Consider  one  particular  trial  illustrated  in  Fig.  5 
and  Fig.  6  where  ocean  currents  had  values  Vc  =  0.25 
m/s  and  Xj/c  =  0  radians.  The  results  for  the  differ¬ 
ent  cases  are  presented  in  Table  2.  For  the  case  with 
no  ocean  currents,  the  “alternating  algorithm”  creates 
paths  with  numerous  loops  when  two  successive  points 
are  close  together  and  the  vehicle  orientation  does  not 
allow  for  the  second  point  to  be  reached  without  long 
maneuvers  (Fig.  6(a)).  This  is  avoided  in  the  proposed 
algorithm  by  generating  sequences  that  are  feasible  but 


Table  2.  Simulation  Results  for  one  particular 
trial  as  illustrated  In  Fig.  5  and  Fig.  6. 


No  current 

With  current 

Alternating 

Proposed 

Alternating 

Proposed 

Algorithm 

Algorithm 

Algorithm 

Algorithm 

'I'max 

97.4 

65.3 

121. 1 

76.0 

Tavg 

88.4 

58.6 

101.6 

62.0 

limit  the  number  of  additional  loops  (Fig.  6(b)).  Similar 
results  are  obtained  with  the  presence  of  ocean  currents 
as  shown  in  Fig.  6(c)  and  Fig.  6(d). 

Note  that  the  proposed  algorithm  produced  differ¬ 
ent  sequences  for  the  case  with  no  ocean  currents  and 
the  case  with  ocean  currents.  This  is  because  the  bid¬ 
ding  scheme  considers  the  possibility  that  two  succes¬ 
sive  points  that  were  reachable  in  the  absence  of  ocean 
currents  may  no  longer  be  reachable  without  extra  loops 
due  to  the  increase  in  turning  radius  from  the  ocean  cur¬ 
rents.  Also,  the  paths  generated  by  the  proposed  algo¬ 
rithm  attempts  to  avoid  paths  that  force  the  vehicles  to 
drive  against  the  ocean  current.  Instead,  paths  that  al¬ 
low  the  ocean  current  to  aid  the  vehicle  in  the  direction 
of  travel  are  favoured. 

For  a  sufficiently  dense  sets  of  points,  it  becomes 
clear  that  the  ordering  of  the  Euclidean  tours  are  not 
optimal  in  the  case  of  the  Dubins  MTSP.  This  is  due 
to  the  fact  that  there  is  little  relationship  between  the 
Euclidean  and  Dubins  metrics,  especially  when  the  Eu¬ 
clidean  distances  are  small  with  respect  to  the  turning 
radius.  An  algorithm  for  the  Euclidean  problem  will 
tend  to  schedule  very  close  points  in  a  successive  or¬ 
der,  which  can  imply  long  maneuvers  for  the  AUV.  This 
is  clearly  demonstrated  by  the  numerous  loops  that  be¬ 
come  problematic  with  dense  sets  of  points.  The  algo¬ 
rithm  proposed  in  this  paper  does  not  rely  on  the  Eu¬ 
clidean  solution  and  therefore,  even  in  the  presence  of 
ocean  currents,  can  create  paths  that  are  feasible  for  cur¬ 
vature  bound  vehicles. 

7.  CONCLUSION 

This  paper  addresses  the  task  allocation  of  closely 
spaced  targets  for  vehicles  that  follow  paths  of  bounded 
curvature  in  the  presence  of  constant  ocean  currents. 
The  proposed  algorithm  is  based  on  using  a  bidding 
scheme  to  allocate  tasks  to  robots  while  using  the  Du¬ 
bins  set  to  calculate  the  cost  of  bids  which  consider  both 
the  vehicle  constraints  as  well  as  the  effect  of  ocean  cur¬ 
rents.  Simulations  with  a  non-linear  model  of  the  RE¬ 
MUS  AUV  indicate  that  the  proposed  algorithm  yield 
better  performance  for  dense  sets  of  points  when  com- 
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Figure  6.  Simulation  Results,  (a)  Alternating 
algorithm,  v,.  =  0,  (b)  Proposed  algorithm,  vv=  0, 

(c)  Alternating  algorithm,  v,  =  0.25  m/s,  v^,.=  0, 

(d)  Proposed  algorithm,  0.25  m/s,  =  0 


pared  to  the  “alternating  algorithm".  It  is  shown  that  so¬ 
lutions  based  on  computing  Euclidean  tours  that  do  not 
have  curvature  constraints  have  extra  loops  when  task 
points  are  close  together  relative  to  the  turning  radius  of 
the  vehicle.  Currently,  this  algorithm  is  being  tested  on 
an  lver2  AUV. 
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ABSTRACT 

This  research  addresses  the  problem  of  allocating  closely  spaced  targets  to  multiple  autonomous 
underwater  vehicles  in  the  presence  of  constant  ocean  currents.  The  main  difficultly  of  this  problem  is 
that  the  nonholonomic  vehicles  are  constrained  to  move  along  forward  paths  with  bounded  curvatures. 
The  Dubins  model  [1]  is  a  simple  but  effective  way  to  handle  the  kinematic  characteristics  of  AUVS.  It 
gives  complete  characterization  of  the  optimal  paths  between  two  configurations  for  a  vehicle  with 
limited  turning  radius  moving  in  a  plane  at  constant  speed. 

In  the  proposed  algorithm,  Dubins  paths  are  modified  to  include  ocean  currents,  resulting  in  paths 
defined  by  curves  whose  radius  of  curvature  is  not  constant.  To  determine  the  time  required  to  follow 
such  paths,  an  approximate  dynamic  model  of  the  AUV  is  queried  due  to  the  computational  complexity  of 
the  full  model.  The  lower  order  model  is  built  from  data  obtained  from  sampling  the  full  model.  The  full 
model  is  used  in  evaluating  the  final  tour  times  of  the  sequences  generated  by  the  proposed  algorithm  to 
validate  the  results. 

The  proposed  algorithm  solves  the  task  allocation  problem  with  market-based  auctions  that 
minimize  the  total  travel  time  to  complete  the  mission.  The  novelty  of  the  research  is  the  path  cost 
calculation  that  combines  a  Dubins  model,  an  AUV  dynamic  model,  and  a  model  of  the  ocean  current. 
Simulations  were  conducted  in  MATLAB  to  illustrate  the  performance  of  the  proposed  algorithm  using 
20  task  points  and  3  AUVs.  The  task  points  were  generated  randomly  and  uniformly  inside  a  square  with 
side  lengths  of  22  meters.  The  task  points  were  generated  close  together  to  highlight  the  necessity  for 
considering  the  curvature  constraints. 

As  a  baseline  for  comparison,  the  “alternating  algorithm”  described  by  Savla  et  al.  [2]  is  used  for 
the  creation  of  Dubins  TSP  tours  (i.e.  sequences  from  applying  Dubins’  model).  It  works  as  follows: 
given  a  set  of  n  points,  the  optimal  Euclidean  MTSP  tours  (i.e.  that  do  not  consider  path  curvature)  are 
computed  using  auctions.  Then,  it  is  necessary  to  obtain  a  feasible  path  through  these  ordered  points  using 
the  method  in  [2]  which  includes  the  curvature  constraints  of  the  vehicle. 

The  proposed  algorithm  was  tested  on  ten  different  datasets  and  compared  to  the  “alternating 
algorithm”.  For  a  sufficiently  dense  sets  of  points,  it  becomes  clear  that  the  ordering  of  the  Euclidean 
tours  are  not  optimal  in  the  case  of  the  Dubins  MTSP.  This  is  due  to  the  fact  that  there  is  little  relationship 
between  the  Euclidean  and  Dubins  metrics,  especially  when  the  Euclidean  distances  are  small  with 
respect  to  the  turning  radius.  An  algorithm  for  the  Euclidean  problem  will  tend  to  schedule  very  close 
points  in  a  successive  order,  which  can  imply  long  maneuvers  for  the  AUV.  This  is  clearly  demonstrated 
by  the  numerous  loops  that  become  problematic  with  dense  sets  of  points.  The  algorithm  proposed  in  this 
paper  does  not  rely  on  the  Euclidean  solution  and  therefore,  even  in  the  presence  of  ocean  currents,  can 
create  paths  that  are  feasible  for  curvature  bound  vehicles. 


Field  tests  were  also  conducted  on  an  Iver2  AUV  (Fig.  1)  at  the  California  Polytechnic  State 
University’s  Center  for  Coastal  Marine  Sciences  to  validate  the  performance  of  the  proposed  algorithm. 
Missions  created  based  on  the  sequences  generated  by  the  proposed  algorithm  were  conducted  to  observe 
the  ability  of  AUVs  to  follow  paths  of  bounded  curvature  in  the  presenee  of  oeean  currents. 


Figure  1 .  The  Iver2  AUV  in  Avila  Bay,  CA  after  being  launehed  from 
Cal  Poly’s  Center  for  Coastal  Marine  Scienee 
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Algae  Grown  on  Dairy  and  Municipal  Wastewater  for 
Simultaneous  Nutrient  Removal  and  Lipid  Production  for 

Biofuel  Feedstock 
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Abstract:  Algae  grown  on  wastewater  media  arc  a  potential  source  of  low-cost  lipids  for  production  of  liquid  biofuels.  This  study 
investigated  lipid  productivity  and  nutrient  removal  by  green  algae  grown  during  treatment  of  dairy  farm  and  municipal  wastewaters 
supplemented  with  CO2.  Dairy  wastewater  was  treated  outdoors  in  bench-scale  batch  cultures.  The  lipid  content  of  the  volatile  solids 
peaked  at  Day  6,  during  exponential  growth,  and  declined  thereafter.  Peak  lipid  content  ranged  from  14-29%,  depending  on  wastewater 
concentration.  Maximum  lipid  productivity  also  peaked  at  Day  6  of  batch  growth,  with  a  volumetric  productivity  of  17  mg/day/L  of 
reactor  and  an  areal  productivity  of  2.8  g/m^/day,  which  would  be  equivalent  to  11,000  L/ha/year  (1,200  gal/acre/year)  if  sustained  year 
round.  After  12  days,  ammonium  and  orthophosphate  removals  were  96  and  >99%,  respectively.  Municipal  wastewater  was  treated  in 
scmicontinuous  indoor  cultures  with  2-4  day  hydraulic  residence  times  (HRTs).  Maximum  lipid  productivity  for  the  municipal  wastewater 
was  24  mg/day/L,  observed  in  the  3-day  HRT  cultures.  Over  99%  removal  of  ammonium  and  orthophosphate  was  achieved.  The  results 
from  both  types  of  wastewater  suggest  that  C02-supplemented  algae  cultures  can  simultaneously  remove  dissolved  nitrogen  and  phos¬ 
phorus  to  low  levels  while  generating  a  feedstock  potentially  useful  for  liquid  biofuels  production. 
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Introduction 

Biofuels  produced  from  plants  have  the  potential  to  replace  a 
significant  fraction  of  our  fossil  fuel  needs  with  a  renewable  al¬ 
ternative  (Perlack  et  al.  2005).  However,  concern  has  grown  that 
the  use  of  food  crops  for  production  of  ethanol,  biodiesel,  or  other 
renewable  fuels  will  increase  foexi  prices  while  having  little  im¬ 
pact  on  greenhouse  gas  emissions  (Fargione  et  al.  2008).  Prior 
work,  in  particular  the  Aquatic  Species  Program  sponsored  by  the 
U.S.  Department  of  Energy,  suggested  that  algae  arc  capable  of 
producing  oil  suitable  for  conversion  to  biodiesel  with  an  areal 
productivity  20-40  times  that  of  oilseed  crops,  such  as  soy  and 
canola  (Sheehan  ct  al.  1998).  However,  an  economic  study  of 
such  processes  (Benemann  and  Oswald  1996)  suggested  that 
large-scale  algae  cultivation  solely  for  biofuel  production  was  not 
economical,  and  the  writers  reemphasized  the  integration  of  bio¬ 
fuels  production  and  wastewater  treatment  with  CO2  supplemen- 
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tation,  as  first  suggested  by  Oswald  and  Golueke  (1960).  In 
particular,  assimilation  of  wastewater  nutrients  by  algae  followed 
by  algae  harvesting  via  sedimentation  were  considered  potentially 
practical  and  economical  approaches  to  biofuel  production. 

Use  of  algae  for  municipal  wastewater  treatment  in  ponds  is 
well  established  (Oswald  et  al.  1953;  Oswald  2003),  and  algae- 
based  treatment  of  dairy  and  piggery  waste  also  has  been  inves¬ 
tigated  (e.g.,  Craggs  et  al.  2004;  Kebede-Westhead  ct  al.  2006; 
Mulbry  et  al.  2008;  An  et  al.  2003).  Algae  growth  in  wastewater 
treatment  ponds  contributes  to  treatment  mainly  through  dis¬ 
solved  oxygen  production  and  nutrient  assimilation.  However,  the 
carbon: nitrogen  and  carbon: phosphorus  ratios  in  domc.stic  sewage 
(C:N  3.5:1;  C:P  20:1)  and  dairy  lagoon  water  (C:N  3:1;  C:P  10:1) 
are  low  compared  to  typical  ratios  in  rapidly  growing  algae  bio¬ 
mass  (C:N  6:1;  C:P  48:1)  (Metcalf  and  Eddy  2003;  USDA  1992; 
Oswald  1960).  This  dearth  of  carbon  leads  to  limitations  in  algae 
production  and  incomplete  assimilation  of  wastewater  nutrients 
by  algae.  The  experiments  described  in  the  present  research  over¬ 
came  the  carbon  limitation  of  the  wastewaters  by  addition  of  CO2 
to  the  cultures.  The  effects  of  this  addition  on  both  algae  growth 
and  nutrient  assimilation  were  measured.  In  future  applications, 
CO2  could  be  supplied  by  the  flue  gas  from  power  plants  and 
other  sources.  A  schematic  of  one  envisioned  process  is  shown  in 
Fig.  1. 

CO2  supplementation  of  algae  cultures  to  increase  productivity 
has  been  studied  for  many  years  (Burlew  1953),  as  has  the  use  of 
flue  gas  as  a  CO2  source  for  algae  culture  (Straka  et  al.  2000). 
CO2  supplementation  to  promote  nutrient  removal  has  also  been 
studied  briefly  in  outdoor  ponds  (Benemann  et  al.  1980).  How¬ 
ever,  the  production  of  lipids  was  not  measured  in  these  studies. 

Lipid  content  for  pure  cultures  of  algae  has  been  reported  to 
range  from  1-85%,  and  the  lipids  exhibit  varying  carbon  chain 
lengths,  degrees  of  unsaturation,  and  polarity  [e.g.,  reviews  in 
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Fig.  1.  Simplified  process  How  diagram  envisioned  for  algae  waste 
water  treatment  and  liquid  biofuel  production 


Fig.  2.  Outdoor  algae  growth  tanks  for  batch  experiments  with  dairy 
wastewater 


Chisti  (2007),  Metting  ( 1996),  and  Enssani  (1987)].  However,  the 
lipid  content  and,  more  important,  the  lipid  productivity  of  poly¬ 
cultures  of  algae,  such  as  wastewater  pond  algae,  have  seldom,  if 
ever,  been  reported.  Further,  lipid  content,  fatty  acid  profile,  and 
bioma.ss  produetivity  depend  on  environmental  conditions,  cultur¬ 
ing  methods,  and  growth  phase  (Thompson  1996;  Tsuzuki  et  al. 
1990).  In  particular,  nitrogen  limitation  increases  lipid  eontent  in 
some  .species  (Spoehr  and  Milner  1949;  Leman  1997).  However, 
nitrogen  limitation  decrea.ses  growth  rate,  which  can  lead  to  de¬ 
creased  overall  lipid  productivity  (Shifrin  and  Chisholm  1981). 
Benemann  and  Tillctt  (1987)  investigated  this  problem,  but  maxi¬ 
mizing  lipid  productivity  remains  an  outstanding  problem. 

While  a  few  studies  have  reported  the  lipid  content  of  waste- 
grown  algae  cultures  [e.g.,  25%,  En.s.sani  (1987)],  lipid  produc¬ 
tivities  for  waste-grown  poly  cultures  apparently  have  not  been 
reported  previously.  The  research  presented  herein  was  conducted 
to  determine  the  lipid  content  and  lipid  produetivity  of  microalgac 
grown  for  nutrient  removal  from  two  types  of  wastewater — dairy 
and  municipal. 

Methods 

Overview  of  Experiments 

Two  sets  of  experiments  were  run  in  parallel  to  determine  algae 
growth,  nutrient  removal,  and  lipid  productivity  in  municipal 
wastewater  and  dairy  wastewater.  The  municipal  wastewater  ex¬ 
periment  monitored  algae  growth  under  scmicontinuous  operation 
for  18  days  to  study  the  effects  of  CO^  levels  and  hydraulic  resi¬ 
dence  times  (HRTs)  on  algae  growth  and  nutrient  removal.  Con¬ 
trol  cultures  with  addition  of  air  only  (no  CO2)  were  used  to 
simulate  the  carhon  limitation  typical  of  wastewater  ponds  and  to 
differentiate  the  effect  of  CO2  addition  on  productivity.  In  the 
dairy  wastewater  experiment,  lipid  productivity  and  nutrient  re¬ 
moval  were  monitored  during  1 5  days  of  hatch  growth  to  study 
the  effect  of  the  growth  cycle  on  lipid  content. 

Coiiection  and  Pretreatment  of  Wastewater 

For  the  municipal  wastewater  experiments,  60  L  of  primary  clari¬ 
fier  elfluent  was  collected  at  the  San  Luis  Obispo,  California, 
municipal  wastewater  treatment  facility.  The  wastewater  was 
mixed  thoroughly  and  pa.ssed  through  screens  with  196-txm  open¬ 
ings  (commercial  house  paint  filters).  The  screened  wastewater 
was  stored  in  4-L  HOPE  containers  at  -10°C. 

For  the  dairy  wastewater  experiments,  frcc-stall  barn  flush 
water  was  collected  from  a  storage  pond  at  the  400-hcad  Cal  Poly 


Dairy  in  San  Luis  Ohispo.  In  flush  operations  at  this  dairy,  the 
flush  water  is  passed  through  a  bar  screen  and  sand  trap  and  then 
collected  in  a  covered  sump.  The  wastewater  is  then  pumped  over 
a  wedge-wire  inclined  screen,  which  removes  feed  and  other  fine 
solids,  before  being  discharged  to  the  0.5-ha  storage  pond.  Wa.stc- 
watcr  for  the  research  was  collected  from  the  storage  pond  and 
then  treated  in  an  anaerobic  digester  before  being  used  in  algae 
growth  experiments.  The  130-L  digester  was  unheated,  unmixed, 
and  fed  semicontinuously  to  achieve  a  6-wcck  hydraulic  resi¬ 
dence  time. 

Municipal  Wastewater  Experimental  Procedures 

Eight  1-L  Pyrex  Roux  bottles  (Fisher  Scientific,  Rockford,  111.) 
were  used  as  algae  growth  reactors  for  the  municipal  wastewater 
experiments.  Each  bottle  was  placed  vertically  on  a  magnetic  .stir¬ 
rer  and  mixed  by  a  polyctrafluoroethylcnc  (PTFE)-coatcd  2.5-cm 
magnetic  stir  bar  spinning  at  approximately  300  rpm.  The  bottles 
were  illuminated  from  two  sides  by  a  total  of  four  4()-W  full- 
spectrum  fluorescent  hulbs  (Duro-test  Vitalitc  Lighting,  Inc., 
Philadelphia)  operated  on  a  16  h:8  h  lightidark  cycle.  When  on, 
the  bulbs  provided  an  average  illuminance  that  totaled  4,300  lx  at 
the  two  faces  of  each  bottle  (Lutron  LX-101  m),  which  is  equiva¬ 
lent  to  about  12  W/m^  of  photosynthctically  active  radiation  (Li- 
Cor  2008). 

To  provide  gas  exchange,  each  bottle  was  sparged  with  either 
air  or  a  C02-air  mixture  through  a  cylindrical  polypropylene  dif¬ 
fuser  36  mm  long  and  9  mm  in  diameter.  Gas  was  delivered  to  the 
diffusers  through  a  manifold  of  4-mm  inside  diameter,  clear  vinyl 
tubing  with  manual  flow  control  valves.  For  bottles  sparged  with 
air-C02  mixtures,  gases  were  mixed  hy  a  gas  mixer  (Model  665, 
Matheson  Co.  Ine.,  USA)  that  was  eonnected  to  a  50-lb  tank  of 
99.97%  CO2  and  a  2.5-psi  aquarium  air  pump  (Maxima  Air  Pump 
Model  A-805,  Hagen  Corp.,  Mansfield,  Mass.).  The  CO2  coneen- 
tration  in  the  blend  was  .set  to  maintain  pH  between  7.0  and  8.0. 
For  the  Roux  bottles  that  were  sparged  with  air  alone,  the  4-mm 
tubing  was  connected  to  a  3-W  aquarium  air  pump  (Profile  1500, 
Meiko  Pet  Corp.,  Taiwan). 

The  culture  volume  in  each  Roux  bottle  was  800  mL.  Waste- 
water  was  introduced  into  the  bottles  with  a  daily  draw-fill  pro¬ 
cedure  at  the  end  of  the  light  period.  Three  daily  hydraulic 
loading  rates  were  tested — 200,  267,  and  400  niL  of  primary 
effluent —  in  order  to  achieve  4-,  3-,  and  2-day  HRTs,  re.spcc- 
tively.  For  the  air-C02  sparged  treatments,  each  HRT  was  run  in 
duplicate.  For  the  air-only  treatment,  the  3-day  HRT  was  run  in 
duplieate.  Culture  media  temperature  ranged  from  23  to  25 ®C 
and  did  not  vary  between  the  bottles  more  than  1.5°C. 
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Dairy  Wastewater  Experimental  Procedures 

For  the  dairy  wastewater,  algae  were  cultured  outdoors  in  six 
40-L  rectangular  glass  aquarium  tanks  (Fig.  2).  The  tanks  were 
filled  with  20  L  of  effluent  from  the  anaerobic  digester.  To  better 
.simulate  light  conditions  in  ponds,  sunlight  was  allowed  to  enter 
the  tanks  only  through  the  top  water  surface  by  masking  the  tank 
walls  up  to  the  waterline  with  black  tape.  A  Plexiglas  cover  ex¬ 
cluded  rainfall,  but  a  gap  was  provided  between  the  cover  and  the 
tanks  for  ventilation. 

In  preliminary  experiments  with  undiluted  dairy  wastewater 
algal  growth  was  poor,  presumably  due  to  the  high  opacity  of  the 
wastewater.  Therefore,  the  subsequent  experiments  reported  here 
used  10  and  25%  wastewater  diluted  with  tap  water.  Each  experi¬ 
mental  treatment  was  run  in  triplicate  with  air  sparging  at  1.5 
Umin  for  mixing  and  separate,  simultaneous  pure  CO2  sparging 
at  approximately  0.015  L/min,  which  controlled  culture  pH. 

The  experiment  was  run  during  March  2007  when  the  average 
daily  solar  radiation  was  203  W/m^  (California  Irrigation  Man¬ 
agement  Information  System  Station  #52).  The  average  water 
temperature,  measured  daily  at  3:00  p.m.,  was  30.6 °C.  Water 
samples  were  collected  between  3:00  and  3:30  p.m. 

Inoculation 

Algae  inoculum  was  collected  from  local  ponds  treating  munici¬ 
pal  or  winery  wastewater  and  from  a  creek.  The  inoculum 
samples  contained  a  wide-ranging  mixture  of  green  algae  and 
diatoms,  which  were  identified  by  cell  morphology  using  phase- 
contrast  microscopy  with  reference  to  Presscott  et  al.  (1978). 
Prominent  genera  included  Actinastrum,  Scenedesmus,  Chlorella, 
Spirogyra,  Nitzschia,  Micractinium,  Golenkinia,  Chlorococcum, 
Closterium,  Euglena,  and  two  unidentified  species.  The  municipal 
culture  inoculum  contained  625  mg/L  volatile  suspended  solids 
(VSS)  and  was  added  to  the  wastewater  media  in  a  2%  (v/v)  ratio. 
For  the  dairy  cultures,  the  inoculum  concentration  was  500  mg/L 
VSS,  added  at  a  10%  (v/v)  ratio. 

Water  Quality  Analyses  and  Lipid  Extraction 

VSS  concentrations  were  determined  gravi metrically  according  to 
Standard  Methods  (APHA  2005).  Temperature  and  pH  were 
monitored  to  characterize  growth  conditions.  Nutrient  removal 
was  evaluated  by  analyzing  for  nitrite,  nitrate,  and  orthophosphate 
using  a  Dionex  DX  120  ion  chromatograph  with  an  AG9-HC 
lonPac  Guard  Column,  AS9-HC  4-mm  lonPac  IC  column,  DS4-1 
Detection  Stabilizer,  and  an  AS40  Automated  Sampler.  Total  am¬ 
monia  nitrogen  (NH3+NHI-N)  concentrations  were  determined 
using  the  Ammonia-Selective  Electrode  Method  (APHA  4500- 
NH3D).  Organic  nitrogen  was  determined  using  the  Macro- 
Kjeldahl  method  (APHA  Method  4500-Norg). 

To  complete  a  nitrogen  balance  for  the  Roux  bottle  experi¬ 
ments,  it  was  necessary  to  quantify  the  volatilization  of  ammonia. 
This  quantity  was  determined  by  passing  the  sparged  gas  through 
a  boric  acid  solution.  This  procedure  was  conducted  for  one  Roux 
bottle  of  each  duplicate.  A  two-hole  stopper  with  4-mm  tubing 
allowed  sparging  gas  in  and  directed  sparged  gas  out  and  into  the 
boric  acid  solution  through  a  polypropylene  diffuser.  The  diffuser 
was  submersed  12  cm  in  a  graduated  cylinder  under  100-200  mL 
of  boric  acid  indicating  solution  (APHA  45OO-NH3C.  3.b.).  At 
the  end  of  a  mass  balance  period,  deionized  (DI)  water  was  added 
to  the  graduated  cylinder  to  compensate  for  evaporation.  This 


Table  1 .  Initial  Wastewater  Characteristics 


Wastewater 

characteristics 

Dairy 

wastewater 

Municipal 

wastewater 

25% 

dilution 

10% 

dilution 

No 

dilution 

TSS  (mg/L) 

283 

135 

93 

VSS  (mg/L) 

220 

120 

58 

pH 

7.9 

7.7 

7.2 

Ammonium  as  N  (mg/L) 

30.5 

16.3 

39 

Nitrate  as  N  (mg/L) 

<0.01 

0.05 

<001 

Nitrite  as  N  (mg/L) 

<0.01 

0.04 

<0.01 

Organic  nitrogen  (mg/L) 

50.7 

20.2 

12 

TKN  (mg/L) 

81.0 

36.5 

51 

Total  nitrogen  (mg/L) 

81.0 

36.6 

51 

Phosphate  as  P  (mg/L) 

2.6 

1.8 

2,1 

solution  was  then  titrated  back  to  its  original  pH,  and  its  ammonia 
concentration  was  calculated  according  to  APHA  45OO-NH3C. 

The  lipid  content  of  the  VSS  was  analyzed  gravimetrically  by 
a  procedure  adapted  from  Bligh  and  Dyer  (1 959)  by  Benemann 
and  Tillett  (1987).  The  method  consisted  of  solvent-based  extrac¬ 
tion  to  isolate  both  polar  and  nonpolar  lipids  from  cell  biomass 
and  water.  The  VSS  of  each  sample  was  measured  to  determine 
the  concentration  of  algal  biomass  in  the  wastewater  effluent.  A 
2(X)-mL  aliquot  of  the  same  sample  was  centrifuged  in  a  PTFE 
tube  to  form  an  algae  pellet  for  lipid  extraction.  After  decanting, 
the  pellet  was  resuspended  in  4  mL  of  DI  water  and  frozen  until 
extraction.  For  extraction,  the  samples  were  thawed,  and  5  mL  of 
chloroform  and  10  mL  of  methanol  were  added.  The  samples 
were  then  sonicated  continuously  in  the  centrifuge  tube  for  I  min. 
(Branson  Sonifier  250  with  a  Model  #102  tip).  The  samples  were 
then  placed  on  a  shaker  table  overnight.  The  next  day  an  addi¬ 
tional  5  mL  of  chloroform  and  5  mL  of  DI  water  were  added  to 
make  the  final  ratio  of  chloroform: methanol: water  10:10:9.  The 
samples  were  then  vortexed  for  30  s.  After  the  samples  had  been 
homogenized,  they  were  centrifuged  at  7,000  rpm  for  4  min.  The 
lipids  were  soluble  in  the  chloroform,  which  formed  a  dense  layer 
at  the  bottom  of  the  centrifuge  tube.  The  remaining  cell  debris 
created  a  middle  layer,  while  the  methanol  and  water  created  a  top 
layer.  The  lipid-chloroform  layer  was  removed  with  a  pipette  and 
filtered  through  a  0.2- fxm  nylon  syringe  filter.  The  filtrate  was 
deposited  into  a  tared  aluminum  tray.  The  tray  was  then  placed 
into  a  desiccator  flushed  with  nitrogen  to  allow  the  chloroform  to 
evaporate.  A  second  extraction  was  performed  by  adding  an  ad¬ 
ditional  10  mL  of  chloroform  to  the  centrifuge  tube,  and  the  mix¬ 
ture  was  again  vortexed  and  centrifuged.  This  second  extraction 
was  placed  into  a  separate  tared  tray  and  evaporated  under  nitro¬ 
gen.  The  trays  were  then  dried  at  105°C  for  1  h.  After  cooling  in 
a  desiccator,  the  trays  were  weighed  to  the  nearest  0.01  mg.  Add¬ 
ing  the  weights  of  the  two  extractions  from  each  sample  gave  the 
total  lipid  weight. 


Results  and  Discussion 

Influent  Wastewater  Characteristics 

The  municipal  primary  wastewater  characteristics,  as  well  as  the 
initial  conditions  in  the  dairy  wastewater  bioreactors  immediately 
after  inoculation  are  reported  in  Table  1.  After  dilution,  the  25% 
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Table  2.  Culture  Conditions  in  Dairy  Wastewater  Experiment 


Day 

Insolation 

(W/m‘) 

Air  temperature  (®C) 

Water  temperature 
at  3  p.m.  {°C) 

Average  pH 

a 

Max 

Min 

Average 

10%  dairy 
wastewater 

25%  dairy 
wastewater 

0 

32 

7.7 

7.9 

1 

50 

13.6 

9.9 

11.4 

15 

7.4 

7.5 

2 

191 

17.3 

7.3 

11.3 

30 

7.2 

7.1 

3 

228 

24 

11.4 

16.3 

36 

8.9 

7.4 

4 

228 

20.9 

7.5 

13.1 

35 

9.3 

7.6 

5 

70 

14.4 

9.5 

12 

17 

7.0 

7.3 

6 

212 

17.9 

10.6 

13.1 

32 

6.5 

7.1 

7 

169 

17.8 

8.6 

11.6 

29 

7.3 

8.4 

8 

226 

15.8 

4.5 

9.1 

27 

8.6 

9.5 

9 

246 

16.3 

4.5 

10.4 

32 

7.5 

7.7 

10 

252 

22.3 

4.5 

12.9 

37 

6.4 

6.4 

11 

247 

24.2 

5.1 

13 

34 

7.1 

7.3 

12 

246 

20.9 

5 

114 

36 

8.3 

8.0 

13 

242 

22.1 

7.9 

13.4 

37 

7.3 

14 

239 

20.8 

7.4 

13.2 

15 

246 

24.1 

7.8 

13.5 

^Standard  deviation  of  replicates  ranged  from  0.0  to  0.5. 


dairy  wastewater  had  ammonium  and  orthophosphate  concentra¬ 
tions  similar  to  the  undiluted  municipal  wastewater. 

Culture  Conditions 

The  laboratory  municipal  wastewater  cultures  were  grown  under 
steady  conditions  as  described  in  the  Methods  section.  However, 
the  outdoor  dairy  wastewater  cultures  experienced  widely  varying 
conditions  both  daily  and  over  the  course  of  the  experiments 
(Table  2).  The  average  24  h  insolation  ranged  from 
50-252  W/m^.  Due  to  manual  adjustment  of  CO2  flow,  pH 
ranged  from  6.5-8.9.  The  water  temperatures  in  all  the  tanks  were 
similar  and  reached  as  high  as  37 °C  (Table  2). 

Aigal  and  Lipid  Productivity 

The  scmicontinuous-flow  experiments  with  municipal  wastewater 
reached  nearly  .steady-state  biomass  concentrations  after  1 1  days 
of  operation,  although  VSS  was  higher  on  the  18th  day,  when 


4-Day  HRT  C02  -•-3-Day  HRT  C02 

-^j- 3-Day  HRT  Air  -□-2-Day  HRT  C02 


Fig.  3.  Biomass  concentrations  during  scmicontinuous  flow  treat¬ 
ment  of  municipal  wastewater  (mean  of  duplicates) 


lipid  samples  were  taken  (Fig.  3).  For  the  3-day  HRT  cultures, 
sparging  with  CO2  more  than  doubled  the  VSS  concentration 
compared  to  sparging  with  air.  For  the  treatments  with  CO2  sparg¬ 
ing,  biomass  production  was  similar  for  the  3-  and  4-day  HRTs, 
with  steady-state  VSS  concentrations  of  7(X>-8(X)  nig/L.  In  con¬ 
trast,  the  steady-state  VSS  concentration  for  the  C02-sparged 
2-day  HRT  treatment  was  only  300  mg/L.  The  municipal  waste- 
water  cultures  were  dominated  by  algae  in  the  Chlorella,  Micrac- 
tiniwn,  and  Actinastrum  genera. 

The  lipid  contents  of  the  algae  from  the  municipal  wastewater 
experiments  ranged  from  4.9-1 1 .3%  of  VSS  by  weight  (Table  3). 
Despite  the  relatively  low  lipid  contents  observed,  short  residence 
times  and  high  biomass  production  rates  resulted  in  lipid  pnxluc- 
tivities  ranging  from  9.7  mg/L/day  (air- .sparged)  to  24  mg/L/day 
(C02-sparged  3-day  HRT). 

Lipid  production  using  dairy  wastewater  was  measured  in 
batch  experiments  with  two  different  dilutions  of  wastewater 
(10%  and  25%).  Biomass  concentrations  increased  to  maximum 
values  of  500  mg/L  VSS  at  Day  6  for  the  10%  dilution  (Fig.  4) 
and  900  mg/L  VSS  at  Day  13  for  the  25%  dilution  (Fig.  5).  The 
higher  biomass  production  for  the  25%  dilution  was  likely  due  to 
the  higher  nutrient  concentrations  (Table  I).  The  dairy  wa.stewater 
cultures  were  dominated  by  Scenedesmus,  followed  by  Micrac- 
tiniim,  Chlorella,  and  Actinastrum.  These  were  the  same  genera 
that  dominated  in  the  municipal  wastewater  cultures,  except  that 
Scenedesmus  was  absent  in  the  municipal  cultures. 

For  both  dairy  wastewater  dilutions,  the  highest  lipid  content 


Table  3.  Lipid  Productivity  of  Municipal  Wastewater  Cultures 


Sample 

VSS 

(mg/L) 

Lipids 

(%) 

Lipid  content  of 
culture  medium 
(mg/L) 

Lipid  productivity 
(mg/L/day) 

CO,  4-day  HRT 

843 

4.9 

41.5 

10.4 

CO2  3-day  HRT 

812 

9.0 

73.3 

24.4 

Air  3-day  HRT 

317 

9.3 

29.2 

9.7 

CO,  2-day  HRT 

412 

11.3 

46.2 

23.1 
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Fig.  4.  Biomass  concentration  and  cell  lipid  content  during  batch 
algae  growth  on  10%  dairy  wastewater  (mean  of  triplicates) 


was  observed  during  the  exponential  growth  phase,  and  it  de¬ 
clined  thereafter  (Figs.  4  and  5).  The  total  lipid  content  of  bio¬ 
mass  from  the  10%  dilution  ranged  from  8-14%,  and  that  of  the 
25%  dilution  ranged  from  10-29%  by  weight.  In  comparison, 
total  lipid  content  of  pure  Scenedestnus  and  Chlorella  cultures  has 
been  reported  to  range  from  12-45%  (Thompson  1996). 

For  the  dairy  wastewater  experiments,  the  maximum  lipid  pro¬ 
duction  rate  was  17  mg/L/day  on  a  volumetric  basis  or 
2.8  g/m^/day  on  an  area  basis,  achieved  by  Day  6  for  the  25% 
dilution.  In  comparison,  previous  research  with  open-surface  sys¬ 
tems  growing  pure  cultures  have  shown  somewhat  higher  produc¬ 
tion  rates  ranging  from  4-7.9  g/m^/day  [Table  4  (Laws  1984; 
Thomas  1984;  Brown  1990)]. 

In  both  the  batch  and  semicontinuous  experiments,  peak  lipid 
content  was  associated  with  high  biomass  growth  rates.  For  the 
dairy  wastewater  experiments,  the  highest  lipid  content  and  pro¬ 
ductivity  was  achieved  during  exponential  growth  for  both  the  10 
and  25%  dilution  experiments,  rather  than  during  later  phases 
when  nutrient  concentrations  were  low  (Figs.  4,  5,  and  7).  For  the 
indoor  municipal  wastewater  experiment,  the  highest  lipid  content 
(11%)  was  observed  at  the  shortest  HRT  (2  days).  In  these 
.semicontinuous-flow  experiments,  the  shorter  retention  time  cor- 
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Fig.  5.  Biomass  concentration  and  cell  lipid  content  during  batch 
algae  growth  on  25%  dairy  wastewater 


responded  to  more  rapid  biomass  growth  and  greater  lipid  pro¬ 
ductivity.  Thus  high  lipid  production  was  associated  with  rapid 
growth  for  both  batch  dairy  and  semicontinuous  municipal  waste- 
water  experiments.  Roessler  (1990)  has  discussed  similar  results 
of  increased  lipid  content  in  the  exponential  growth  phase  of  mi¬ 
croalgae  and  theorized  that  at  lower  biomass  concentrations  with 
less  self-shading,  algae  biosynthesize  lipid  storage  products  as  a 
means  of  capturing  excess  light  energy.  In  contrast,  others  have 
found  higher  lipid  content  in  cultures  that  were  nutrient  limited 
(Leman  1997;  Spoehr  and  Milner  1949). 

The  maximum  observed  lipid  productivity  of  the  dairy  waste 
reactors  (2.8  g/m^/day)  corresponds  to  about  11, 000  L/ha/year 
(1,200  gal/acre/year).  Without  improvements,  productivity  in  full- 
scale  high-rate  algae  ponds  is  expected  to  be  lower  due  to  factors 
such  as  winter  insolation  and  temperature,  predation,  maintenance 
downtime,  and  shifts  in  algal  strains.  For  example,  assuming  300 
days/year  of  operation,  the  productivity  would  be  reduced  to 
9,000  L/ha/year  (960  gal/acre/year).  An  additional  uncertainty  in 
scale-up  estimates  stems  from  the  difference  in  operational  modes 
for  the  dairy  wastewater  experiments  (batch)  and  typical  high-rate 
pond  wastewater  treatment  (continuous).  Theoretically,  the  maxi¬ 
mum  growth  rate  achieved  in  batch  culture  could  also  be  achieved 
in  continuous  flow  culture  (Gualtieri  and  Bar.santi  2005).  Of 
course,  the  actual  productivity  for  a  full-scale  system  will  depend 
on  local  environmental  conditions,  cultivation  parameters,  domi¬ 
nant  algal  strains,  etc.  Furthermore,  the  suitability  of  the  algal 
lipids  for  fuel  production  will  depend  on  the  lipid  characteristics 
(e.g.,  polarity,  saturation  level,  and  chain  length)  and  the  ease  of 
extraction. 

Much  higher  algal  lipid  productivities  have  been  envisioned 
[e.g.,  42,600-136,900  L/ha/year,  Chisti  (2007)]  than  were  ob¬ 
served  in  this  study.  However,  even  this  study’s  oil  production 
estimate  of  9,000  L/ha/year  is  18  times  greater  than  the  490  L/ha/ 
year  reported  for  soybean  oil  production  (USDA  2005). 

Nutrient  Removal 

For  the  municipal  wastewater,  over  99%  ammonium  and  ortho¬ 
phosphate  removal  was  achieved  for  C02-spargcd  treatments  with 
both  3-  and  4-day  HRT  (Table  5).  To  determine  the  fate  of  the 
removed  ammonium  and  to  validate  the  results,  a  nitrogen  bal¬ 
ance  was  calculated  on  four  occasions  over  10  days  of  operation. 
The  results  were  similar  on  all  4  days,  and  Fig,  6  shows  the 
balance  for  Day  1 8.  The  average  recovery  achieved  was  96%  with 
a  standard  deviation  of  8.7%.  Ammonium  was  the  main  form  of 
nitrogen  in  the  influent  wastewater,  and  after  algal  growth,  or¬ 
ganic  nitrogen  was  predominant  (Fig.  6).  Ammonia  volatilization 
was  minor,  the  greatest  amount  being  <1  mg/bottle/day  from 
the  air-sparged  treatment,  which  accounts  for  <7%  of  the  influent 
total  nitrogen.  Since  this  treatment  developed  the  highest  pH 
(10.3)  due  to  lack  of  CO2  sparging,  it  was  the  most  prone  to 


Table  4.  Comparison  of  the  Lipid  Productivity  of  Dairy  Wastewater  Cultures  to  That  Reported  by  Others 


Study 

Lipid  produciiviiy 
(g/m^/d) 

Algal  species 

Growth  vessel 

Medium 

Laws  (1984) 

7.9 

Platymonas  sp. 

Air  lift  flume 

Sea  water 

Thomas  (1984) 

4.5 

Tetraselmis  suecica 

Indoor  reactor 

Nutrient  enriched  .seawater 

Brown  (1990) 

4 

Cylcotella  cryptica 

Open  pond 

Si  deficient  media 

This  study 

2.8 

Polyculture 

Open  reactor 

Anaerobic  treated  dairy  wastewater 
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Table  5.  Nutrient  Removal  by  Municipal  Wastewater  Cultures 

Total  ammonia  nitrogen  (mg/L) 


Phosphate  as  P  (mg/L) 


Influent 

Effluent^ 

%  Removal 

Influent 

EffluenC 

%  Removal 

CO.  4-day  HRT 

39.0 

<0.02 

>99% 

2.1 

<0,02 

>99% 

CO.  3-day  HRT 

39.0 

<0.02 

>99% 

2.1 

<0.02 

>99% 

Air  3-day  HRT 

39.0 

6.1  (±0.89) 

84% 

2.1 

<0,02 

>99% 

CO.  2-day  HRT 

39.0 

0.6  (±0.57) 

98% 

2.1 

0.15  (±0.15) 

9y9t 

^Mean  of  duplicate  reactors  with  standard  deviation  shown  in  parentheses. 


Influent 


□  Ammonium-N  ONitrite-N  HNitrate-N  □  Organic  N 


Effluent 


H  Ammonium -N  DNitrite-N  BNitrate-N  □  Organic  N  HVolN 

Fig.  6.  Nitrogen  balance  for  municipal  wastewater  cultures  on  Day 
18  (means  of  duplicates).  “Vol  N”  is  volatilized  nitrogen  captured  in 
a  boric  acid  solution. 


35  1 


Fig.  7.  Nutrient  removal  during  batch  culture  (triplicates)  on  25% 
dairy  wa.stewater 


0.02  mg/L  NO3-N.  Similar  results  were  observed  with  the  10% 
dairy  wastewater  dilution.  Nitrite  showed  a  slight  increase  at  Day 
6  up  to  0.5  mg/L  NOJ-N,  indicating  some  nitrification.  Similar  or 
higher  ammonium  removal  efficiencies  were  observed  by  other 
researchers  for  algae-based  treatment  (Table  7). 


ammonia  volatilization.  The  nitrite  observed  in  the  2-day  HRT 
effluent  (Fig.  6)  indicates  incomplete  nitrification  of  ammonia  for 
this  .short  retention  time. 

Removal  of  ammonium  and  orthophosphate  from  the  batch 
dairy  wastewater  was  96%  and  >99%,  respectively  by  Day  15 
(Table  6).  For  the  25%  dilution  experiment,  initial  concentrations 
of  total  ammonia  nitrogen  were  30  mg/L  and  were  reduced  to 
<5  mg/L  in  6  days  (Fig.  7).  The  initial  orthophosphate  phos¬ 
phorus  concentration  of  2.6  mg/L  was  reduced  to  0.6  mg/L  in  9 
days,  and  it  was  completely  removed  by  Day  12.  Nitrate  concen¬ 
trations  were  consistently  below  0.3  mg/L  for  both  conditions, 
and  final  nitrate  concentrations  were  below  the  detection  limit  of 


Conclusions 

This  research  provided  a  proof  of  concept  for  a  wastewater  treat¬ 
ment  process  that  combines  nutrient  removal  and  algal  lipid  pro¬ 
duction  for  potential  use  as  a  biofuel  feedstock.  CO^ 
supplementation  was  used  to  accelerate  treatment  and  growth  in 
both  outdoor  and  indoor  mixed-species  cultures.  Ammonium  and 
orthophosphate  removals  were  nearly  complete  for  both  munici¬ 
pal  wastewater  and  diluted  dairy  wastewater.  This  study  also  con¬ 
tributed  data  on  both  the  lipid  content  and  the  lipid  productivity  of 
wastewater-grown  algae,  a  rarely  addressed  topic.  Lipid  content 
ranged  from  4.9-29%,  and  lipid  productivity  reached 
2.8  g/m^/day.  While  this  lipid  productivity  is  many  times  higher 


Table  6.  Nutnent  Removal  in  Dairy  Wastewater  Experiment  at  Day  15 


Total  ammonia  nitrogen  (mg/L)^ 

Phosphate  as  P  (mg/L)^ 

Influent 

Effluent 

%  removal 

Influent 

Effluent 

%  removal 

25%  dilution 

30.5  (±0.4) 

1.1  (±0.1) 

967r 

2.6  (±0.7) 

<0.02 

>99% 

10%  dilution 

16.3  (±4.8) 

0.6  (±0.1) 

96% 

1.8  (±0.01) 

<0.02 

>99% 

‘‘Average  of  triplicate  reactors  (standard  deviation,  «  =  3). 
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Table  7.  Comparison  of  Total  Ammonia  Nitrogen  Removal  to  That  Reported  for  Other  Algae  Treatment  Systems 


Study 

%  total 

ammonia-N  removal 

Algae  species 

Medium 

Martinez  et  al.  (2000) 

80-99 

Scenedemus  obliques 

Autoclaved  municipal  wastewater 

Lincoln  et  al.  (1996) 

99 

Arthrouspira  plantensis 

Anaerobically  treated  dairy  wastewater 

Green  et  al.  (1995) 

99 

Polyculture 

Municipal  wastewater 

This  study 

99 

Polyculture 

Municipal  wastewater 

This  study 

96 

Polyculture 

Anaerobically  treated  dairy  wastewater 

than  that  of  terrestrial  oil  plants,  higher  productivity  is  a  goal  of 
continuing  research.  In  addition,  the  suitability  of  the  lipids  for 
fuel  production  by  transesterification  and  other  means  needs  to  be 
determined.  Overall,  the  waste-to-biofuel  approach  of  this  study 
avoids  many  of  the  cost  and  food  competition  issues  of  other 
biofuel  feedstocks  while  providing  a  valuable  wastewater  treat¬ 
ment  service. 
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an  effort  to  find  ways  to  create  scalable  arrays  of  neutral  atoms  that  allow  bringing  atoms  together  and  apart  for 
qubit  gate  operations,  we  are  exploring  the  dependence  of  different  dipole  trap  and  optical  lattice  geometries  on  the 
ap  light  polarization.  Several  dark  spot  optical  lattice  and  dipole  trap  geometries  that  have  sufficiently  low  scattering 
tes  for  laser  detunings  comparable  to  the  (ground  state)  hyperfine  splitting  have  been  proposed  [1,  2].  To  fully 
(plore  the  polarization  dependence  of  these  traps,  we  explicitly  calculate  the  full  expression  for  the  optical  dipole 
atential  for  this  case,  based  on  the  expression  given  in  [3].  We  will  present  our  progress  towards  identifying  trap 
jometries  with  different  light  polarizations  that  might  be  used  to  bring  atoms  together  and  apart  for  two-qubit  gates.  1 . 
hys.  Rev.  A  70  032302  (2004),  2.  Phys.  Rev.  A  73  013409  (2006),  3.  Phys.  Rev.  A  57(3)  1972  (1998). 
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A  unique  configuration,  known  as  an  Underpowered  Aircraft,  allows  for  the  modification 
of  gliding  flight  vehicles  for  increased  range  and  lower  cost  when  compared  with  fully 
powered  flight  vehicles.  Intentionally  under-sizing  the  powerplant  for  a  flight  vehicle  allows 
the  designer  to  choose  a  powerplant  that  will  not  only  perform  the  mission  requirements,  but 
will  also  provide  the  customer  with  the  most  cost  effective  solution,  as  some  missions  may  not 
require  fully  powered  flight.  Specifically,  the  underpowered  aircraft  concept  studied  in  this 
paper  is  a  gliding  flight  aircraft  that  does  not  have  enough  power  for  climbing  or  level  flight, 
but  does  have  enough  power  to  overcome  some  of  the  drag  forces  associated  with  flight,  in 
turn  increasing  the  effective  range  of  the  vehicle.  In  this  paper,  the  underpowered  aircraft 
concept  was  analyzed  and  its  feasibility  was  determined.  Analysis  done  using  equations  of 
motion,  followed  by  a  more  accurate  numerical  integration  including  a  thrust  lapse, 
determined  that  the  underpowered  aircraft  concept  provides  a  unique  method  for  a  cost 
effective  range  extension  technology  for  gliding  flight  vehicles.  Finally,  the  technology  and 
methods  of  this  paper  were  applied  to  the  AGM-154  JSOVV  and  JSOW-ER  glide  munitions 
and  it  was  determined  that  JSOW-ER  is  representative  of  an  underpowered  aircraft  with 
our  analysis.  This  paper  represents  a  “back-of-the-envelope”  investigation  into  the 
underpowered  aircraft  concept. 


Nomenclature 


English 

V 

velocity 

AR 

= 

aspect  ratio 

W/P 

power  loading 

AR^ 

= 

representative  aspect  ratio  =  eAR 

4 

energy  height 

Cd 

drag  coefficient 

Q 

lift  coefficient 

Greek 

D 

= 

drag 

a  = 

angle  of  attack 

W 

= 

weight 

*lp  ~ 

propeller  efficiency 

E 

= 

energy 

6 

flight  path  angle 

e 

= 

Oswald  efficiency  factor 

(pT  = 

thrust  vectoring  angle 

h 

height,  altitude 

1  1 

Subscripts 

K 

neAR  nAR* 

max  = 

maximum 

L 

= 

lift 

o  = 

T 

parasite 

thrust 

L/D 

= 

lift  to  drag  ratio 

to  = 

takeoff 

m 

= 

mass 

P/W 

= 

power  to  weight  ratio 

Acronyms 

Ps 

= 

specific  excess  power 

KE 

kinetic  energy 

R/C,  RoC 

= 

rate  of  climb 

PE 

potential  energy 

T 

= 

thrust 

UAV 

unmanned  aerial  vehicle 

T/W 

= 

thrust  to  weight  ratio 
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I.  Introduction 

IT  is  not  typical  for  an  aircraft  designer  to  undersize  the  powerplant  for  their  aircraft.  However,  as  the  emphasis 
on  cost  in  the  aerospace  industry  continues  to  increase,  the  need  to  meet  customer  requirements  through  the 
most  cost  effective  means  presents  itself  in  almost  all  engineering  problems.  In  a  time  where  the  cost  of  fuel  is 
fluctuating  unpredictably,  manufacturing  and  labor  costs  are  increasing,  and  high  technology  systems  bring  the 
development  cost  up,  the  need  to  perform  and  fly  a  mission  must  be  as  cost  effective  as  possible.  Using  the 
technology  of  an  '‘underpowered”  aircraft  (an  aircraft  that  only  has  enough  power  to  overcome  some  of  the  drag 
forces  associated  with  flight)  has  the  potential  to  reduce  the  operating  and  propulsion  system  cost  when  compared  to 
standard  aircraft  systems  that  are  capable  of  climbing  or  level  flight.  Possible  mission  applications  for  the 
technology  include  cargo  delivery  for  deployed  troops  in  the  battlefield,  glide  munitions,  stand-off  weapons,  and 
others. 

The  underpowered  aircraft  concept  comes  from  the  idea  that,  for  specific  missions,  an  aircraft  system  may  not 
necessarily  need  to  overcome  all  of  the  drag  forces  associated  with  flight,  and  can  therefore  operate  with  an  under¬ 
sized  powerplant.  If  the  purpose  of  the  aircraft  is  to  glide  to  its  target,  then  the  effective  range  of  the  aircraft  can  be 
increased  by  making  the  aircraft  underpowered.  By  doing  so,  the  aircraft  does  not  need  the  same  power  as  a  standard 
aircraft  would  to  achieve  level  or  climbing  flight,  but  can  successfully  operate  off  of  smaller  amounts  of  power 
while  greatly  extending  the  range  of  the  vehicle.  Adding  power  to  the  aircraft,  in  small  amounts,  allows  the  aircraft 
to  increase  the  effective  mission  range,  for  little  horsepower  and  low  cost,  as  will  be  shown  in  this  paper.  The 
performance  of  an  underpowered  aircraft  will  be  analyzed  and  the  cost  advantages  will  be  determined.  A  more 
detailed  numerical  integration  analysis  of  the  flight  path  will  also  be  presented  and  validation  of  the  analysis  will  be 
conducted  when  compared  to  a  glide  munition  operating  off  of  the  same  flight  principles. 

II,  Underpowered  Aircraft  Performance 

The  idea  of  an  underpowered  aircraft  arises  to  fill  the  need  to  increase  the  range  of  gliding  aircraft  systems. 
Payload  delivered  using  a  gliding  system  provides  for  a  cheap  and  simple  delivery  mechanism  when  constructed 
from  light  weight,  inexpensive  materials.  The  system  can  be  designed  to  be  single  use  or  reusable,  depending  on  the 
exact  purpose.  However,  just  using  a  standard  gliding  aircraft  does  not  provide  the  range  capability  often  needed  for 
payload  delivery.  Assuming  the  underpowered  aircraft  is  dropped  from  a  high  altitude,  an  engine  can  be  sized  and 
selected  to  provide  the  desired  range.  The  trade  space  between  range,  flight  velocity,  and  drop  altitude  for  an 
underpowered  aircraft  will  be  explored.  The  following  analysis  will  assume  a  payload  delivery  mission  and  then 
other  mission  profiles  will  be  analyzed  afterwards. 

Two  methods  were  used  to  determine  the  performance  for  the  underpowered  aircraft.  First,  the  standard  method 
of  looking  at  the  forces  acting  on  the  aircraft  via  a  free-body  diagram  was  applied.  Estimates  for  the  drag  polar  of 
the  aircraft  were  also  developed,  which  yielded  an  estimate  of  flight  conditions.  This  was  followed  by  a  numerical 
integration  to  provide  a  more  accurate  measure  and  to  account  for  thrust  lapse.  Emphasis  was  placed  on  the  lift  to 
drag  ratio  {L/D)  due  to  the  vehicle’s  operation  in  gliding  flight.  In  an  abstract  trade  study  such  as  this,  aircraft 
characteristics  are  treated  as  technology  that  can  be  applied  to  an  aircraft  in  the  design  process,  allowing  for  an 
overall  performance  trade  study. 

A.  Equations  of  Motion  Analysis 

To  start,  Figure  1  shows  the  standard  forces  acting  on  an  aircraft  in  flight  for  use  in  the  equations  of  motions 
analysis. 


Figure  1.  Forces  Acting  on  an  Aircraft  in  Flight 
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The  forces  acting  on  the  aircraft  are  standard  and  include  the  lift,  drag,  thrust,  and  weight  of  the  aircraft.  The 
velocity,  flight  path  angle,  Q,  and  the  angle  of  attack,  a,  are  also  shown.  The  flight  path  angle  is  defined  as  the  angle 
between  the  horizontal  and  the  velocity  vector  and  the  angle  of  attack  is  defined  as  the  angle  between  the  velocity 
vector  and  the  arbitrarily  defined  body  axes  for  the  aircraft.  In  the  case  of  thrust  vectoring,  the  thrust  vector  is  offset 
by  the  angle  ipj,  to  model  any  effects  from  thrust  vectoring  on  the  performance  of  the  aircraft. 


This  analysis  assumes  that  there  is  no  thrust  vectoring  happening  in  the  flight  of  the  aircraft.  Thus,  summing  the 
forces  in  the  X  and  Z-axis  for  steady  flight  yields 


T  =  D  i-W  s\n  9 
L  =  W  cos  9 

Thus,  we  reorganize  equation  1  to  find  the  classical  aircraft  performance  equation 


sin  9  = 


T-D 

w 


(1) 

(2) 

(3) 


For  gliding  flight,  our  interest  lies  in  the  flight  path  angle,  0,  of  the  vehicle.  By  minimizing  the  flight  path  angle 
to  a  small  negative  number,  the  range  of  the  aircraft  can  be  maximized.  So,  wc  have 


0  =  sin-1  (---) 
\w  wJ 

From  equation  2  above  and  a  small  angle  approximation,  wc  have 


0  =  sin  M  — -T 


W  il 

With  the  power  to  weight  ratio  (in  units  of  hp/lb)  defined  as 

V 


w  \wJ 


5507/p 


(4) 


(5) 


(6) 


B.  Drag  Polar 

One  of  the  key  characteristics  needed  to  properly  model  the  performance  of  an  aircraft  is  an  accurate 
representation  of  the  drag  polar  for  the  entire  aircraft.  The  form  of  the  drag  polar  that  will  be  used  for  the  analysis  is 


Cd  =  Coo  + 


nAR* 


(7) 


For  the  purposes  of  this  study,  the  aspect  ratio,  AR,  of  the  aircraft  will  be  grouped  together  with  the  Oswald 
efficiency  factor,  e,  to  become  a  representative  aspect  ratio,  AR"^.  In  an  abstract  trade  study  such  as  this  no 
information  is  available  on  the  efficiency  of  the  wing  design;  however  a  feel  for  the  efficiency  factor  can  still  be 
gained  through  a  representative  aspect  ratio.  If  we  assume  that  the  aircraft  is  operating  at  conditions  that  give  the  Ci 
for  best  L/D  for  the  gliding  condition,  then  we  know  that* 


So,  the  lift  to  drag  ratio  is 


Cl  = 

I  ^Do 

yj  ttAR* 

II 

2Coo 

L 



^max 

Cd 

yJnAR* 

2Coo 


AttAR*  C[)q 


(8) 

(9) 


(10) 
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Reorganizing,  an  estimate  of  the  parasite  drag  can  be  determined  through 

nAR* 

-  Y 

Dmax^ 

This  allows  us  to  treat  the  aerodynamics  of  the  aircraft,  AR*  and  -  ,  as  technology. 

^max 


(12) 


III.  Powerplant  Cost  Estimation 

With  the  performance  for  the  underpowered  aircraft  concept  established,  the  cost  benefits  of  the  technology  were 
determined.  Such  a  vehicle  can  be  powered  either  by  traditional  internal  combustion  piston  engines  or  small  jet 
turbine  engines.  In  order  to  get  an  estimate  for  the  cost  saving  of  the  vehicle,  estimates  of  small  piston  and  jet 
turbine  engines  were  developed.  As  seen  below  in  Figure  2,  a  span  of  cost  competitive  small  piston  engines  was 
used  to  determine  a  cost  trend  that  was  acquired  through  a  survey  of  retail  prices  found  online  in  August,  2008. 
These  engines  included  small  RC  aircraft  engines  from  O.S.  Engines,  general  purpose  engines  from  Honda  and 
Kawasaki,  as  well  as  a  few  larger  Rotax  aircraft  engines.  The  model  yields  an  excellent  correlation  coefficient  and 
the  results  are  consistent  with  the  investigative  nature  of  this  paper. 
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Figure  2.  Small  Piston  Engine  Cost 

Figure  3  shows  a  similar  trend  for  small  jet  turbine  engines.  Due  to  the  fact  that  the  payload  delivery  vehicles 
and  stand-off  “glide  munitions”  where  this  technology  would  be  used  are  not  large  in  size,  the  engine  study  was 
limited  to  model  aircraft  jet  engines  as  well  as  jet  engines  used  in  small  UAV  applications.  These  engines  include 
manufacturers  such  as  JetCat,  foreign  engine  manufacturers  such  as  SimJet,  and  others.  This  model  is  indicative  of 
the  low  thrust  engines  needed  for  underpowered  applications.  The  model  yields  acceptable  results  with  a  correlation 
coefficient  of  82%. 
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Figure  3.  Small  Jet  Turbine  Engine  Cost 


IV.  Underpowered  Aircraft  Flight  Performance 

Since  the  concept  for  this  aircraft  is  based  on  that  of  a  glider,  the  performance  of  the  aircraft  has  been  determined 
to  represent  the  trade  space  of  velocity,  range,  and  drop  altitude.  So,  using  the  relationships  derived  earlier  and 
performance  code  written  in  MATLAB,  some  performance  trends  were  calculated. 

It  is  assumed  in  this  analysis  that  the  underpowered  aircraft  is  dropped  Irom  altitude  at  the  start  of  the  flight.  Two 
altitudes  of  10,000  feet  and  25,000  feet  were  chosen  to  give  a  comparison  between  a  low  altitude  drop  and  a  high 
altitude  drop.  The  drop  aircraft  eould  consist  of  any  type  of  vehicle  that  is  capable  of  carrying  the  underpowered 
aircraft  to  the  drop  altitude.  Winds  aloft  are  not  included  in  the  analysis.  The  analysis  presented  assumes  that  the 
underpowered  vehicle  is  dropped  at  the  velocity  of  best  L/D  and  that  during  the  glide  the  vehicle  operates  at  the  best 
L/D  for  glide. 

As  the  lift  to  drag  ratio  is  increased,  the  thrust  required  to  get  the  aircraft  to  reach  its  destination  decreases,  which 
can  be  seen  in  Figure  4.  Only  a  small  amount  of  thrust  is  required  to  keep  the  aircraft  in  a  level  flight  condition,  but 
a  significantly  larger  amount  of  thrust  is  needed  to  have  a  positive  rate  of  climb  for  the  aircraft  (represented  by  the 
+3  degree  climb  angle  curve).  The  difference  in  gliding  flight,  level  flight,  and  positive  rate  of  climb  flight  is 
indicative  of  the  trade  space  between  range,  velocity,  and  drop  altitude  (10,000  feet  for  these  curves).  It  is  also 
indicative  of  the  trade  in  the  cost  of  the  system,  as  having  an  aircraft  that  is  capable  of  positive  rate  of  climb  requires 
a  significantly  larger  amount  of  thrust  and  therefore  a  larger,  more  expensive  powerplant.  It  is  important  to  note  that 
there  are  no  additional  assumptions  built  into  the  figure  below  and  the  plot  is  derived  solely  from  aircraft 
performance  metrics. 


American  Institute  of  Aeronautics  and  Astronautics 
5 


Figure  4.  Underpowered  Jet  Aircraft  Performance  from  a  10,000  ft  Drop  Altitude 

The  curves  in  Fig.  4  are  a  function  of  thrust  to  weight  ratio  and  lift  to  drag  ratio  which  are  two  of  the  most 
fundamental  aircraft  performance  parameters.  For  these  initial  calculations  the  thrust  lapse  has  been  ignored.  Using 
the  cost  model  presented  earlier  we  can  estimate  the  cost  saving  of  the  underpowered  aircraft  technology.  Assuming 
that  the  vehicle  has  a  takeoff  gross  weight  (TOGW)  of  1,500  pounds  and  can  achieve  a  lift-to-drag  ratio  {L/D)  of  20, 
the  vehicle  requires  a  thrust  to  weight  ratio  0.04  to  achieve  a  range  of  200  nmi.  This  corresponds  to  a  thrust  required 
of  60  Ibf  and  an  engine  cost  of  $7,862.  In  contrast,  the  engine  would  need  to  provide  75  Ibf  for  level  flight  and  150 
Ibf  for  climbing  flight.  This  yields  a  cost  of  $9,500  and  $17,095,  respectively. 

The  same  curves  can  be  represented  for  a  propeller  driven  aircraft  by  including  flight  velocity  and  propeller 
efficiency.  Shown  in  Figure  5  are  the  same  trends  as  a  function  of  power  to  weight  ratio. 
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Figure  5.  Underpowered  Propeller  Aircraft  Performance  from  a  10,000  ft  Drop  Altitude 
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Figure  5  shows  similar  trends  to  Figure  4.  This  plot  speaks  volumes  about  the  underpowered  aircraft  concept.  If 
we  assume  that  the  underpowered  aircraft  can  achieve  a  maximum  lift  to  drag  ratio  of  20  and  has  a  TOGW  of  1 ,500 
pounds,  then  the  aircraft  only  requires  about  20  hp  to  achieve  a  range  of  200  nmi  (even  less  for  shorter  ranges).  The 
same  aircraft  would  require  26  hp  for  level  flight,  and  about  53  hp  for  climbing  flight.  The  underpowered  aircraft 
requires  over  one  half  the  horsepower  to  achieve  the  mission  requirement  which  translates  to  engine  costs  of  $1,577, 
$1,983,  and  $3,694  respectively.  There  are  two  main  assumptions  built  into  this  analysis:  First,  a  propeller  efficiency 
of  0.80  is  assumed  to  convert  from  thrust  to  horsepower  (80%  being  typical  performance  of  most  propellers 
currently  used  today)  and  second,  an  operating  velocity  of  100  mph  (146.6  ft/sec)  was  arbitrarily  chosen  to  represent 
a  reasonable  delivery  speed  for  the  payload  aircraft. 

A  different  presentation  of  the  data  in  Fig.  5,  seen  below  in  Fig.  6,  shows  the  relationship  between  power  loading 
and  lift  to  drag  ratio  for  the  underpowered  aircraft. 


Lift  to  Drag  Ratio 


Figure  6.  Underpowered  Aircraft  Power  Loading  Requirements  for  a  10,000  ft  Drop  Altitude 

This  figure  shows  how  much  of  the  aircraft  (in  weight)  can  be  supported  for  each  unit  of  horsepower  that  the 
engine  on  the  aircraft  will  produce.  If  we  again  assume  that  the  aircraft  has  a  lift  to  drag  ratio  of  20  and  a  weight  of 
1,500  pounds,  then  the  aircraft  can  carry  about  76  pounds  for  each  horsepower.  This  results  in  a  power  to  weight 
ratio  of  0.013  hp/lb  and  about  a  20  hp  engine  as  shown  above  in  the  previous  figures.  This  analysis  also  assumes  a 
propeller  efficiency  of  0.80  and  a  flight  velocity  of  100  mph  as  mentioned  earlier. 

The  same  graphs  were  created  to  look  at  the  performance  of  the  aircraft  from  the  drop  altitude  of  25,000  feet. 
Note  the  significantly  less  power  required  for  the  underpowered  aircraft  to  achieve  a  desired  range  of  200  nmi  in 
Figure  7. 
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Figure  7.  Underpowered  Jet  Aircraft  Glide  Performance  from  a  25,000  ft  Drop  Altitude 

If  we  continue  to  assume  that  the  aircraft  has  a  TOGW  of  1 ,500  pounds  and  can  achieve  a  lift-to-drag  ratio  of  20, 
the  vehicle  will  require  a  thrust  to  weight  ratio  of  0.03  to  achieve  a  200  nmi  range,  a  thrust  to  weight  ratio  of  0.05  to 
achieve  level  flight,  and  a  thrust  to  weight  ratio  of  0.1  to  achieve  a  positive  rate  of  climb.  From  the  cost  models 
presented  above,  the  engine  would  need  45  Ibf  thrust,  75  Ibf  thrust,  and  150  Ibf  thrust  respectively.  This  would 
represent  a  significant  cost  savings  between  $6,161,  $9,500,  and  $17,095  respectively. 

Shown  in  Figure  8  is  the  relationship  between  power  to  weight  ratio  and  lift  to  drag  ratio. 


Figure  8.  Underpowered  Propeller  Aircraft  Performance  from  a  25,000  ft  Drop  Altitude 
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Using  the  same  assumptions  as  before  and  looking  at  an  aircraft  that  can  achieve  an  aerodynamic  lift  to  drag  ratio 
of  20,  and  has  a  weight  of  1,500  pounds,  the  aircraft  will  require  a  power  to  weight  ratio  of  0.01  hp/lb  or  15  hp  to 
reach  the  desired  range  of  200  nmi.  This  would  be  a  minimal  cost  of  SI, 227.  This  is  significantly  less  than  an 
aircraft  that  would  need  to  sustain  level  flight  (approx.  26  hp  or  $1,983)  and  an  aircraft  looking  to  have  a  positive 
rate  of  climb  (approx.  53  hp  or  $3,694).  The  underpowered  aircraft  technology  will  satisfy  the  requirements  with 
significantly  less  cost  due  to  the  much  smaller  engine  required  which  reduces  cost  throughout  the  life  cycle.  These 
values  are  sensitive  to  wing  technology  (lift  to  drag  ratio)  and  will  change  depending  on  the  L/D  that  can  be 
achieved  for  the  vehicle. 

The  power  loading  for  the  underpowered  aircraft  also  significantly  changes  for  the  additional  drop  altitude  of 
25,000  feet  and  allows  the  aircraft  to  glide  a  longer  distance  with  less  power. 


Lift  to  Drag  Ratio 

Figure  9.  Underpowered  Aircraft  Power  Loading  Requirements  for  a  25,000  ft  Drop  Altitude 


Comparing  the  two  drop  altitudes  shows  significant  savings  as  well.  Using  the  same  aircraft  assumptions  as 
before,  namely  a  TOGW  of  1,500  pounds  and  a  maximum  lift  to  drag  ratio  of  20,  we  see  that  a  drop  from  10,000  ft 
achieves  200  nmi  with  a  60  Ibf  engine  and  an  engine  cost  of  $7,862.  This  cost  is  decreased  when  dropped  from 
25,000  ft,  when  the  plane  achieves  the  same  range  with  a  45  Ibf  engine  and  an  engine  cost  of  $6,161 . 


V.  Numerical  Integration  Approach 

While  the  above  analysis  represents  a  “back-of-the-envelope  approach’’,  there  is  one  main  factor  that  was  left 
out;  the  effects  of  velocity  and  altitude  on  powerplant  performance.  This  takes  the  form  of  a  thrust  lapse  that  will 
change  the  maximum  thrust  to  weight  ratio  represented  in  the  earlier  figures,  to  a  typical  flight  thrust  to  weight  ratio 
that  has  been  adjusted  to  represent  actual  flight  conditions.  To  achieve  this,  a  numerical  integration  approach  was 
used  to  examine  the  equations  of  motion,  take  a  thrust  lapse  into  account,  and  give  more  accurate  results  tlian  the 
methods  presented  above. 


Revisiting  the  (ree  body  diagram  in  Figure  1  and  summing  the  forces  in  the  X  and  Z-axis,  we  have 


cos  6  =  — 
w 


sin  6  = 


T-D 

w 


(13) 

(14) 
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Due  to  the  fact  that  our  interest  lies  in  gliding  flight,  we  are  actually  interested  in  the  change  in  altitude  of  the 
vehicle  during  flight  with  respect  to  the  change  in  distance  the  vehicle  travels  along  the  ground.  This  is  essentially 
the  glide  ratio  in  derivative  form.  So,  using  the  free  body  diagram 


ds 

ds  __  fif.  __  VcosO  _  1 

dh  —  VsinO  tanO 

dt 


(15) 


1  _  i 

tanO  T-D 


(16) 


Using  a  thrust  lapse  equation  from  Mattingly^  defined  in  terms  of  the  Mach  number,  A/,  and  the  density  ratio 
from  sea  level,  cr,  we  have 

a  =  0.76(0.907  +  0.262(|M  -  0.5|)^*^}a®-^  (17) 

Setting  up  the  integral  to  integrate  the  flight  path  during  steady  flight,  we  have 


The  numerical  integration  yielded  results  that  provide  a  better  representation  of  the  flight  regime  with  the 
inclusion  of  a  thrust  lapse.  The  trend  in  the  curves  shows  that  the  numerical  model  actually  requires  more  thrust  than 
the  equation  of  motion  or  energy  method  analysis  because  it  now  takes  powerplant  performance  into  account.  The 
powerplant  will  not  perform  at  sea  level  static  conditions  at  high  altitude.  In  an  effort  to  validate  the  results  of  the 
model  presented  above,  a  drop  altitude  of  40,000  ft  was  used  to  match  the  ranges  given  for  the  AGM-154  Joint 
Standoff  Weapon^.  Figure  10  shows  the  results  of  the  numerical  integration. 


Figure  10.  Numerical  Integration  of  Jet  Engine  with  Lapse  from  40000  ft,  Contours  of  Glide  Range 
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According  to  the  AGM-1 54  product  card^  the  unpowered  version  of  the  JSOW  has  an  effective  glide  range  of  70 
nmi  from  a  40,000  ft  drop  altitude.  When  using  the  analysis  of  Figure  10,  for  an  un-powered  vehicle,  this 
corresponds  to  a  lift  to  drag  ratio  of  about  11.  The  weight  reported  for  this  vehicle  is  1,050  Ibf  (depending  on 
variant)\  Recently  reported  in  a  Raytheon  press  release"^  was  a  powered  version  of  the  JSOW,  the  JSOW-ER,  with  a 
300  nmi  range  using  a  1 50  Ibf  thrust  turbojet  engine.  If  we  assume  that  the  powered  version  is  also  dropped  from 
40,000  ft,  and  using  the  same  L/D  as  determined  for  the  un-powered  version,  the  weight  of  the  powered  JSOW-ER 
was  determined  to  be  1,575  Ibf  This  is  very  close  to  the  weight  reported  for  the  un-powered  version,  and  shows  that 
the  JSOW-ER  is  most  likely  an  “underpowered”  vehicle,  utilizing  the  technology  described  in  this  paper. 

As  an  estimation  technique,  the  simpler  equation  of  motion  analysis  was  calibrated  to  match  the  results  of  the 
numerical  integration  analysis.  Figure  1 1  shows  the  same  curves  for  the  simpler  analysis,  including  the  same  thrust 
lapse  model  presented  above,  but  the  density  ratio  is  estimated  at  an  altitude  of  18,000  ft.  This  was  considered  a 
good  estimate  for  our  purposes  of  modeling  the  flight  regime  because  most  of  the  effects  of  the  thrust  lapse  are  seen 
at  lower  altitudes  for  longer  ranges. 
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Figure  11.  Estimated  JSOW  Glide  Performance  from  40000  ft 


VI.  Conclusion 

An  underpowered  aircraft  concept  was  studied  to  determine  the  feasibility  and  cost  effectiveness  of  such  a 
technology,  as  well  as  possible  applications.  It  was  determined,  through  an  equations  of  motion,  energy  method,  and 
numerical  integration  analysis,  that  an  underpowered  aircraft  can  provide  significant  range  extension  for  a  gliding 
flight  vehicle.  The  methods  also  include  a  built  in  thrust  lapse  to  correctly  model  an  underpowered  vehicle’s 
performance  with  altitude.  Also,  the  methods  developed  in  this  paper  were  compared  with  a  current  gliding  vehicle, 
the  AGM-1 54  JSOW  and  JSOW-ER.  It  was  determined,  from  aircraft  metrics  provided  by  Raytheon  and  our 
analysis,  that  the  JSOW-ER  is  most  likely  an  underpowered  aircraft  and  is  representative  of  a  possible  mission 
application  for  the  technology.  Other  applications  include  payload  delivery,  glide  munitions,  UAVs,  and  others. 
Overall,  the  underpowered  aircraft  technology  represents  a  unique  flight  regime,  giving  great  benefit  to  the  user  for  a 
low  overall  cost. 
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ABSTRACT 


Bone  Mass  Preservation  and  Fracture  Risk  Assessment 
with  Bisphosphonate  Therapy  During  Spaceflight 

Christopher  Gardina 

Space  exploration  and  microgravity  have  substantial  negative  effects  on  the 
human  body.  Symptoms  of  space  explorers  include  cardiovascular  deconditioning,  bone 
loss,  muscular  atrophy,  and  impairment  of  neurovestibular  and  sensory  function.  The 
great  loss  of  bone  due  long-duration  spaceflight  increases  fracture  risk,  jeopardizing  the 
success  of  the  mission  and  postflight  recovery.  Bisphosphonates  may  be  able  to 
counteract  this  bone  loss  by  altering  the  remodeling  process.  These  drugs  increase  bone 
mass,  thus  reducing  fracture  risk,  but  also  lead  to  increased  levels  of  fatigue 
microdamage.  Fracture  risk  can  be  lowered  by  increasing  both  bone  mass  (quantity)  and 
bone  quality. 

The  purpose  of  this  study  was  to  create  a  computer  model  to  simulate 
bisphosphonate  treatment  on  astronauts  while  traveling  in  space  in  order  to  examine  the 
ability  of  bisphosphonates  to  maintain  bone  mass  in  a  microgravity  environment  and 
reduce  fracture  risk  of  bone  upon  return  to  Earth.  Various  bisphosphonate  treatment 
potencies  and  bone  balance  ratios  given  at  different  time  points  (either  at  or  before 
spaceflight)  were  examined.  Flight  duration  was  also  varied  to  examine  short-term  (10 
days)  to  long-term  (1  year)  effects  of  microgravity  on  bone  mineral  density  (BMD),  a 
measure  commonly  used  to  estimate  bone  strength,  and  damage  accumulation.  The  model 
predicted  bisphosphonate  treatments  with  low  to  intermediate  suppression  of  remodeling 
activation  and  that  create  higher  bone  balance  ratios  cause  reductions  in  fracture  risk.  The 
simulation  also  predicted  significant  changes  to  BMD  and  damage  upon  return  to  Earth 
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as  the  remodeling  response  readjusted  to  higher  stress  eonditions.  For  treatments  highly 
suppressing  remodeling  aetivation,  these  predieted  postflight  ehanges  ineluded  deereased 
BMD  and  inereased  damage  aeeumulation.  Low  levels  of  remodeling  suppression  led  the 
model  to  predict  substantial  increases  in  BMD  and  small  increases  in  damage  postflight. 
Postflight  ehanges  were  minimal  for  treatments  with  intermediate  suppression. 
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CHAPTER  1:  INTRODUCTION 


1.1  Spaceflight 

Microgravity  has  many  adverse  effects  on  the  human  body  that  hinder  the  ability 
of  astronauts  to  explore  outer  space.  The  physiologic  adaptations  caused  by  unloading 
include  cardiovascular  deconditioning,  bone  loss,  muscular  atrophy,  and  impairment  of 
neurovestibular  and  sensory  function  [1],  The  focus  here  is  on  bone  loss,  which  results 
from  the  reduced  levels  of  stress  caused  by  weightlessness.  This  loss  poses  a  significant 
health  risk  for  astronauts  and  is  a  major  deciding  factor  of  mission  duration.  In  6-month 
missions  to  the  International  Space  Station  (ISS),  astronauts  experienced  up  to  5  percent 
loss  of  bone  mineral  density  (BMD)  in  the  lumbar  spine  and  10  percent  in  the  proximal 
femur  [2].  On  the  MIR  space  station,  the  greatest  bone  loss  observed  in  a  crew  member 
was  on  the  order  of  half  the  mineral  loss  incurred  in  a  lifetime  of  normal  aging  [3].  Upon 
return  to  Earth’s  gravitational  environment,  the  average  fracture  risk  for  a  space  explorer 
paralleled  the  estimated  level  for  70-  to  80-year  old  postmenopausal  women  [4].  While 
bone  has  the  ability  to  recovery  mineral,  it  is  much  slower  than  the  rate  at  which  it  is  lost. 
Complete  recovery  may  take  from  1  to  3  years,  and  in  many  cases  bone  will  never  fully 
recover  the  mineral  lost  during  spaceflight  [5]. 

NASA  and  other  space  exploration  agencies  have  developed  exercise  programs  to 
combat  bone  loss  in  space.  In  earlier  space  missions,  exercise  routines  utilized  bungee 
cords  for  resistive  exercises,  and  stationary  bicycles  and  treadmills  for  longer,  aerobic 
exercises.  More  recent  missions  to  the  ISS  combined  these  older  techniques  with  a  new 
piece  of  equipment,  the  Interim  Resistive  Exercise  Device  (iRED),  focusing  on  resistive 
training.  This  apparatus,  by  sufficiently  increasing  loading  intensity,  may  lead  to  shorter. 
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more  effective  exercise  routines  [5].  Thus  far,  exercise  routines  have  been  able  to  slow 
bone  loss,  but  remain  unsuccessful  at  completely  preventing  it  from  occurring.  NASA 
believes  that  coupling  pharmacological  treatments  with  their  exercise  programs  will 
allow  them  to  reach  their  goal  [4],  Though  the  efficacy  of  many  treatments  such  as 
testosterone,  parathyroid  hormone,  calcium,  vitamin  D,  and  vitamin  K,  arc  being 
investigated,  bisphosphonates  seem  a  likely  candidate  [6].  Bisphosphonatc  therapy  has 
the  potential  to  increase  bone  mass  in  space  just  as  it  does  for  osteoporotic  patients  on 
Earth  [2],  though  the  pharmacokinetic  altering  effects  of  spaceflight  have  yet  to  be 
determined. 

1.2  Properties  of  Bone 

In  a  healthy  individual,  bones  provide  structure  and  support,  and  with  the  help  of 
muscles,  tendons  and  ligaments,  they  allow  for  movement  of  the  body.  There  arc  two 
distinct  types  of  bone  tissue:  cortical  or  compact  bone  and  trabecular  (also  referred  to  as 
cancellous  or  spongy)  bone.  The  main  difference  between  these  two  types  is  their 
porosity.  Cortical  bone  is  fairly  dense  and  non-porous,  while  trabecular  bone  has  a  much 
higher  porosity  and  is  made  up  of  ‘struts’  that  form  an  interconnected  matrix  (Figures  1 . 1 
and  1.2).  Theoretically,  the  porosity  of  bone  tissue  can  be  anywhere  from  0  to  100 
percent;  however,  it  is  almost  always  either  very  high  (trabecular  bone)  or  very  low 
(cortical  bone)  and  rarely  in  the  intermediate  range  [7].  Cortical  bone  contains  cylindrical 
units  called  osteons  (Figure  1.1)  and  typically  has  a  porosity  of  5  to  10  percent.  It  can  be 
found  in  the  shafts  and  outermost  layer  of  bone.  Trabecular  bone,  normally  75  to  95 
percent  porous,  is  contained  deep  inside  the  bone  and  is  filled  with  marrow  [7].  It  is  made 
up  of  a  matrix  of  packets  of  bone. 
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Figure  1.1.  Illustration  of  long  bone  showing  cortical  and  trabecular  bone  |8|. 


Figure  1.2.  A  healthy  trabecular  bone  strut  and  one  with  microdamage  |9]. 


3 


Bone  tissue  experiences  repetitive  stress,  leading  to  the  formation  of 
microdamage.  Remodeling  removes  this  damage,  preventing  fatigue  failure  from 
occurring  under  normal  conditions  [10],  Bone  is  made  up  of  many  packets  of  bone  cells 
and  minerals  that  arc  constantly  undergoing  this  process.  There  arc  three  major  cells  that 
partake  in  remodeling:  osteoblasts,  osteoclasts,  and  osteocytes.  Osteoblasts  and 
osteoclasts  arc  bone-forming  and  bonc-resorbing  cells,  respectively.  Osteocytes  arc 
differentiated  osteoblasts  that  are  now  fused  into  the  bone  matrix.  Their  role  is  to  sense 
mechanical  stimuli  and  send  signals  based  on  what  they  sensed  to  the  surrounding  bone 
cells  [7].  The  3  to  4  month  process  of  remodeling  begins  when  osteoclasts  receive  signals 
to  resorb  damaged  or  fatigued  bone.  Osteoblasts  then  take  over  to  remodel  and  ‘fill  in' 
the  trenches  created  by  the  osteoclasts  [7].  Together,  osteoblasts  and  osteoclasts  make  up 
basic  multicellular  units  (BMUs)  of  bone  (Figure  1.3). 


Figure  1.3.  A  BMU  containing  osteoblasts  and  osteoclasts  [11]. 


BMUs  arc  activated  to  remodel  not  only  in  response  to  increased  microdamage 
[12,13.14,15],  but  also  due  to  disuse  situations  where  bone  use  is  reduced  [16,17]. 
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Exposing  bone  to  fewer  loading  cycles  or  reduced  load  lowers  the  frequency  or 
magnitude  of  strain  experienced  by  the  bone  so  that  its  current  level  of  strength  is  no 
longer  necessary.  Bone  is  largely  remodeled  in  order  to  minimize  bone  mass  while 
maintaining  the  strength  necessary  to  support  the  body  [18].  The  equilibrium  point,  where 
remodeling  due  to  mechanical  loading  is  such  that  bone  resorption  equals  bone  formation, 
varies  from  subject  to  subject.  In  general,  as  applied  force  and  strain  increase,  the  number 
of  cycles  required  to  maintain  bone  mass  decreases  [19]. 

1.3  Bisphosphonates 

Bisphosphonates  provide  new  hope  for  long-duration  space  exploration.  This 
class  of  drugs  treats  diseases  with  elevated  bone  remodeling  by  suppressing  osteoclastic 
function  [18].  Bisphosphonates  suppress  resorption  upon  physical  contact  with 
osteoclasts  [20].  They  have  a  high  affinity  for  bone  mineral  [21]  and  bind  to  bone  in  areas 
where  resorption  has  exposed  hydoxyapatite  [22].  There  are  a  variety  of  bisphosphonates, 
each  having  different  potency  and  cellular  mechanisms  inhibiting  BMU  activation  [23]. 
The  various  potencies  allow  for  a  range  in  the  degree  of  resorption  suppression  [24]. 

Bisphosphonates  vary  due  to  their  chemical  composition  (Figure  1.4).  First 
generation  bisphosphonates,  etidronate,  clodronate,  and  tiludronate,  did  not  have  side 
chains  containing  nitrogen  nor  hydroxyl  groups.  These  first  bisphosphonates  were  less 
potent  and  did  not  specifically  target  bone  as  well  as  those  from  generation  two  [25]. 
Second  generation  bisphosphonates,  including  alendronate,  pamidronate,  and  risedronate, 
each  contain  a  hydroxyl  group  on  the  Ri  side  chain  and  have  a  chain  containing  nitrogen 
on  R2.  The  hydroxyl  group  on  the  carbon  atom  causes  the  increased  affinity  for  bone  and 
the  R:  chain  determines  the  potency  and  mode  of  action  of  the  drug  [25].  The  P-C-P 
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chemical  substmcture  enhances  the  safety  and  efficacy  of  the  compound  by  increasing 
the  affinity  for  calcium  and  resisting  the  metabolic  processes  of  the  body  [25].  Although 
newer  bisphosphonates  have  a  very  high  affinity  for  mineral,  only  about  half  of  any  dose 
reaches  bone  [25],  Once  they  do  reach  bone  and  bind  to  exposed  mineral,  they  can  be 
uptaken  by  osteoclasts.  While  bound  to  osteoclasts,  they  exert  their  inhibiting  effect  by 
interfering  with  enzymatic  activity. 

1 

O  —  P  —  c  —  P  —  o 


Figure  1.4.  Chemical  structure  of  bisphosphonates. 

Bisphosphonates  increase  bone  mass  by  reducing  the  temporary  porosity  created 
by  remodeling  known  as  the  remodeling  space,  and  by  creating  a  positive  bone  balance 
where  more  bone  is  added  than  is  removed  [23,26].  Experimental  data  exists  depicting 
the  resulting  bone  mass  increase  in  patients  with  osteoporosis.  Spinal  BMD  increased  8.8 
percent  and  reduced  vertebral  fractures  by  48  percent  after  3  years  of  alendronate 
treatment  [27].  Another  study  reported  increased  spinal  BMD  throughout  7  years  of 
alendronate  treatment  on  postmenopausal  women  [28]. 

Bisphosphonates  also  can  have  negative  effects  on  bone.  Lowered  remodeling 
levels  increase  microdamage  accumulation  and  reduce  toughness  because  less  damage  is 
removed  [23].  Mineralization  of  the  bones  also  increases,  leading  to  brittlcr  bones  that 
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are  less  resistant  to  crack  propagation.  One-year  studies  of  alendronate  and  risedronate 
treatment  on  dogs  showed  microdamage  accumulation  and  BMU  activation  frequency  to 
be  inversely  proportional  [29].  The  overall  goal  of  these  therapies  is  to  minimize  the 
amount  of  damage  accumulated  while  increasing  bone  mass.  In  the  long  run,  high 
potency  bisphosphonate  treatment  may  in  fact  be  detrimental  if  bone  quality  degrades 
enough  to  increase  fracture  risk  due  to  high  amounts  of  microdamage.  Long-term  effects 
of  bisphosphonates  on  bone  remodeling  still  remain  unclear.  Since  studies  can  take  up  to 
10  years  to  acquire  real  data,  mathematically  modeling  the  data  and  relationships 
obtained  from  shorter  studies  may  be  a  more  effective  method  of  gathering  insight  into 
these  phenomena. 

1.4  Previous  Models 

Computational  models  are  commonly  used  to  test  theories  regarding  the 
adaptation  of  bone  to  mechanical  and  physiological  stimuli.  Early  models  tested  bone’s 
mechanical  adaptation.  Carter  et  al.  [30]  and  Huiskes  et  al.  [31]  were  the  first  to  use  finite 
element  modeling  to  develop  mathematical  relationships  between  mechanical  loading  and 
trabecular  bone  density  [7].  In  their  model.  Carter  et  al.  [30]  focused  on  a  daily 
mechanical  stimulus  based  on  stress  and  an  error  function.  The  error  function  tracked  the 
difference  between  the  stress  stimulus  at  a  given  time  point  and  a  predetermined 
equilibrium  stress  stimulus.  The  apparent  density  of  each  element  in  the  model  was 
adjusted  according  to  the  error  function.  New  modulus  values  were  calculated  by 
multiplying  the  changes  in  density  by  a  constant.  These  new  values  were  used  at  the  next 
time  point  to  recalculate  the  daily  stress  stimulus  for  each  element. 
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Huiskes’  approach  to  model  bone  [31]  has  been  shown  to  be  the  equivalent  of 
Carter’s  but  with  different  coefficients  [7].  The  model  invoked  bone  adaptation  by  using 
strain  energy  density  as  the  mechanical  stimulus.  New  modulus  values  were  calculated 
from  strain  energy  density  as  in  Carter’s  model  [30]  described  above.  The  purpose  of  this 
particular  model  was  to  predict  and  analyze  changes  in  bone  due  to  total  hip 
arthroplasties.  Though  both  of  these  models  were  sufficient  at  simulating  the  mechanical 
environment  that  bone  is  subjected  to,  they  did  not  include  adaptations  due  to  cellular 
responses. 

A  model  by  Hazelwood  et  al.  [18]  incorporates  responses  to  both  mechanical  and 
biological  stimuli.  The  model  takes  into  account  the  cellular  responses  of  BMUs.  It 
predicts  changes  in  porosity  and  elastic  modulus  based  on  simulated  responses  to 
mechanical  stimuli  such  as  disuse  or  overload  and  to  the  biological  stimulus  of  damage 
accumulation.  The  schematic  below  (Figure  1.5)  shows  the  basis  for  the  simulation.  Note 
that  damage  and  disuse  affect  BMU  activation  frequency,  which  in  turn  affects  porosity 
and  modulus.  The  schematic  shows  remodeling  to  be  a  dynamic  loop. 
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Figure  1.5.  Schematic  of  a  bone  remodeling  algorithm  by  Hazelwood  et  at.  |18]. 


In  early  computational  models  simulating  bisphosphonate  effects,  the  basic 
strategy  was  to  match  clinical  results  of  the  treatment.  The  models  simulated  varying 
parameters  such  as  BMU  activation  frequency,  resorption  and  formation  periods,  bone 
balance,  and  mineralization  [32,33,34,23],  but  failed  to  include  other  stimuli  important  to 
long-term  changes  to  BMD.  These  models  did  not  take  into  account  bone  remodeling  due 
to  mechanical  loading  nor  microdamage  accumulation.  Heaney  et  al.  [32]  developed  a 
model  that  was  fairly  accurate  when  predicting  bisphosphonate  effects  on  BMD  out  to  6 
months.  The  model  simulated  treatment  using  the  bone  balance  method  of  decreasing 
bone  turnover,  decreasing  remodeling  space,  increasing  focal  bone  balance,  and  keeping 
bone  mineralization  constant.  Hernandez  et  al.  [33]  developed  a  model  to  compare  this 
method  with  the  mineralization  method  in  which  remodeling  space  is  decreased,  focal 
bone  balance  remains  the  same,  and  bone  mineralization  is  varied.  This  model  included  a 
longer  secondary  mineralization  period  to  account  for  increases  to  BMD  in  the  long  term. 
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The  schematic  shown  in  Figure  1.6  shows  the  lack  of  mechanical  stimuli  in  the  model 


developed  by  Hernandez  et  al.  [33].  Laey  et  al.  [34]  developed  a  model  of 


bisphosphonate  treatment  in  which  various  parameters  were  closely  analyzed.  Activation 


frequency  was  found  to  have  the  greatest  influence  on  predicting  changes  in  bone  volume 
[34]. 


Figure  1.6.  Schematic  of  a  bone  remodeling  algorithm  by  Hernandez  et  al.  |33|. 


A  model  developed  by  Nyman  et  al.  [23]  utilized  both  mechanisms  of  remodeling 
described  previously,  in  response  to  mechanical  loading  and  damage  accumulation,  to 
simulate  the  long-term  effects  of  bisphosphonate  usage.  The  model  was  designed  for 
examining  postmenopausal  osteoporosis,  so  it  also  included  a  bone  remodeling  response 
to  estrogen  deficiency.  The  results  of  the  model  showed  that  the  reduction  of  resorption 
space  caused  by  bisphosphonate  treatment  played  a  key  role  in  increasing  bone  volume 
over  the  long  run.  Also,  Nyman  et  al.  [23]  concluded  that  the  disuse  response  contributed 


10 


to  the  eventual  plateau  of  bone  gain  that  other  models  failed  to  achieve  [32,33].  Overall, 
the  model  showed  incomplete  suppression  of  BMU  activation  frequency  and  positive 
bone  balances  to  permanently  increase  bone  volume  with  minor  gains  in  microdamage 
accumulation  [23].  Various  aspects  of  this  model  are  implemented  in  this  study  and  will 
be  covered  in  more  detail  in  the  next  section  and  in  the  methods  chapter. 

1.5  Simulating  Bisphosphonate  Treatment  during  Spaceflight 

The  goal  of  this  study  is  to  create  a  computer  model  to  simulate  bisphosphonate 
treatment  on  astronauts  while  traveling  in  space  in  order  to  examine  bisphosphonates’ 
ability  to  maintain  bone  mass  in  a  microgravity  environment  and  reduce  fracture  risk  of 
bone  upon  return  to  Earth.  We  will  examine  various  bisphosphonate  treatment  potencies 
and  bone  balance  ratios  given  at  different  time  points  (either  at  or  before  spaceflight). 
Flight  duration  will  also  be  varied  to  examine  short-term  (10  days)  to  long-term  (1  year) 
effects  of  microgravity  on  BMD  and  damage  accumulation.  To  examine  these  effects, 
mathematical  relationships  modeling  bisphosphonate  therapies  [23]  were  applied  to  a 
computational  model  developed  by  Hazelwood  et  al  [18]  that  was  modified  to  investigate 
the  influence  of  microgravity  on  the  bone  remodeling  process. 

This  simulation  will  not  only  increase  the  understanding  of  the  effects  of 
spaceflight  and  bisphosphonate  usage,  but  it  may  also  lead  to  advances  of  other  proposed 
treatments  such  as  parathyroid  hormone,  testosterone,  and  vitamin  K2  [6].  Understanding 
each  therapy  will  eventually  lead  to  better  treatments  on  Earth  and  in  space,  decrease  the 
health  risks  of  space  travel,  and  drastically  expand  the  bounds  of  human  space 
exploration. 


CHAPTER  2:  METHODS 


2.1  Mechanical  Loading 

This  model  simulates  cyclic  uniaxial  loading  of  a  volume  of  vertebral  trabecular 
bone  (Figure  1.1).  Applying  data  from  previous  studies  [35,36,37],  and  assuming  a  linear 
relationship  between  apparent  density  and  porosity  allows  apparent  stiffness  (clastic 
modulus,  £)  to  be  determined, 

£■  =  Eo  ^  (1 -p)^  (1) 

in  units  of  MPa,  where  p  is  porosity,  and  14927  and  1 .33  are  values  of  £o  and  b, 
respectively,  for  trabecular  bone  [18].  Bone  mineral  density  (BMD)  was  calculated  by  a 
porosity  relationship, 

BMD  =  p  X  ( 1  -  p),  (2) 

where  p  is  apparent  density  of  bone  (2.0  g/cm^  when  p  =  0)  [1 8].  Apparent  density  is  the 
measure  of  mass  per  unit  volume,  including  the  voids  spaces  within  the  material. 

Peak  strain  was  calculated  using  Hooke’s  Law, 
e  =  c  I E.  (3) 

The  mechanical  stimulus  modeled  to  stimulate  the  bone  volume’s  response  to  remodeling 
was  defined  as 

O  =  £/,  X  E^,  (4) 

where  £/  is  the  loading  frequency  in  cycles  per  day  and  q  adjusts  the  peak  strain  and 
loading  frequency  to  correctly  model  the  loading  potential  [18]. 
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2.2  Porosity  Transformation 


The  rate  of  change  of  porosity  {p)  is  the  difference  between  the  amount  of  bone 
formation  and  amount  of  bone  resorption  per  given  time  period  [38,39].  It  is  defined  as 
P~  QrNr  -  QfNf,  (5) 

where  Qjt  and  Qf  are  the  mean  bone  resorbing  and  refilling  (forming)  rates,  and  TV/?  and 
Nf  are  the  densities  of  resorbing  and  refilling  BMUs  per  area,  respectively.  The  rate  of 
resorption, 

Qr-  ArITr,  (6) 

and  rate  of  refilling, 

Q^  =  A^tT^,  (7) 

are  assumed  to  be  linear  in  time  [40].  The  area  of  bone  resorbed  (Ar)  and  area  of  bone 
formed  (Af)  were  based  on  a  cement  line  radius  of  0.095  mm  [40].  When  bone  is  in  a 
disuse  state  (<I>  <  <I>o),  refilling  is  reduced  on  bone  surfaces  [41];  thus,  area  of  bone 
formed  during  disuse  was  reduced  to  /1[0.5  +  0.5((l)/(l)o)]  [18].  The  resorption  (Tr)  and 
refilling  (7>)  periods  were  25  and  64  days,  respectively  [23].  These  periods  were  used  to 
calculate  total  number  of  resorbing  BMUs  and  refilling  BMUs  per  given  area.  Integrating 
BMU  activation  frequency,y^  (BMUs/area/time),  over  a  known  time  period  will  result  in 
the  number  per  section  area  of  resorbing  BMUs, 

t 

^R=  lfaindt\  (8) 

1-Tr 

and  the  number  per  section  area  of  refilling  BMUs, 

Nf=  j/Andt'.  (9) 

t-iT^+Tj+Tp) 
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Present  time  is  t  and  Tj  is  a  latency  period  between  resorption  and  refilling  [23]. 


2.3  BMU  Activation 

BMU  activation  frequency,  as  previously  mentioned,  is  the  number  of  active 
BMUs  in  the  section  area  per  day.  It  is  assumed  to  be  a  function  of  the  two  remodeling 
mechanisms  modeled  by  Hazelwood  et  al.  [18],  damage  and  disuse.  Activation  frequency, 

•fa  ^f uidisuse)  f a(dama^e)^^ A  ’  (tO) 

is  also  a  function  of  internal  surface  area  as  BMUs  must  begin  on  a  bone  surface  [  1 8].  Sa 
is  internal  surface  area  per  unit  volume  normalized  to  values  between  0  and  1  by  ^.^max-  It 
was  determined  by  using  a  porosity-surface  area  relationship  developed  by  Martin  [42] 

(11) 

This  accounts  for  decreased  remodeling  in  bone  volumes  with  smaller  surface  areas. 

Changes  in  activation  frequency  due  to  damage  and  disuse  were  modeled 
assuming  sigmoidal  relationships  [18]  between  damage  and  fa(jamaf;ch 


5,4  =  (32.  Ip- 93.  V+  134/-  101/  +28.8p^)  /  5,4max. 


A 


aO  )(./ u(inax)  ^ 


aidamage)  f  ,(f  _f  X  ’ 

J fjO  w  ri(max)  J aO 


and  mechanical  stimulus  and  Ja(disuse), 


(12) 


/.  y«(max)  r  ^  ^ 


(13) 


The  k  values  were  determined  by  matching  the  curves  to  clinical  data  [18].  Coefficients 
A'b,  and  kg  define  the  shape,  slope,  and  inflection  point  of  the  curves,  respectively.  The 
maximum  activation  frequency  ifaonaxi)  of  0.50  BMUs/mm  /day  was  higher  than  the 
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highest  measured  activation  frequency  (0.14  BMUs/mm  /day)  for  human  cortical  bone 
because  it  is  assumed  the  measurements  did  not  reach  the  upper  limits  [43,18], 

2.4  Microdamage  Accumulation 

Microdamage  (D)  is  defined  as  total  crack  length  per  section  area  of  bone. 
Damage  accumulation  due  to  fatigue  is  modeled  according  to  Martin’s  work  [44]  as 
D=Df-Dr  (14) 

where  Dp  and  Dr  are  the  damage  formation  and  removal  rates,  respectively.  Based  on 
Martin’s  findings,  we  assumed  the  rate  of  damage  formation  to  be  proportional  to  the 
loading  potential  [18], 

Dr  =  kD^  O.  (15) 

This  model  assumes  a  random  distribution  of  BMUs  and  damage  in  the  section  area  of 
bone;  however,  a  damage  removal  specificity  factor  is  included  when  modeling  the  rate 
of  removal  due  to  evidence  showing  that  damage  initiates  the  activation  of  BMUs  [9,10, 
14,15,18], 

Dr  =  D/oArFs.  (16) 

The  specificity  factor,  Fs,  was  assumed  to  be  5  based  on  experimental  data  [44].  Initial 
equilibrium  is  defined  here  as  the  time  at  which  the  rate  of  damage  formation  is  equal  to 
the  rate  of  damage  removal  [18].  Setting  both  equations  equal  allows  us  to  determine  the 
damage  rate  coefficient, 

ko  =  DofaoAFj^,  (17) 

where  initial,  equilibrium  values  are  designated  by  the  subscript  0.  These  values  were 
obtained  from  Hazelwood  et  al.  [18]. 
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2.5  Preflight  Conditions 


Before  applying  microgravitational  conditions,  preflight  parameters  were 
calculated  (Table  2.\)  using  constants  derived  from  experimental  data  (Table  2.2).  These 
parameter  values  were  obtained  by  executing  the  model  developed  by  Hazelwood  ct  al. 
[18]  until  the  values  reached  equilibrium.  The  applied  stress  on  earth  modeled  to  reach 
these  values  was  determined  by  matching  the  predicted  bone  porosity  of  the  model  to 
0.78,  a  porosity  typical  of  vertebral  trabecular  bone  in  adult  males  in  Earth’s  gravitational 
environment  [45,46,23].  The  calculated  applied  stress,  1  MPa,  was  based  on  a  100  mm^ 
cross-section  from  the  modeled  1  cm^  trabecular  bone  volume  (Figure  2.1)  [23].  The 
resulting  preflight  BMD  was  0.44  g/cm\ 


Table  2.1.  Model  parameters  with  values  obtained  from  simulating  remodeling  in  trabecular 
bone  before  entering  space  and  at  the  end  of  a  180-day  space  simulation. _ 


Parameter  (units) 

Deseription 

Preflight 
trabeeular  bone 

End  of  flight  values 
(180-day) 

£*(MPa) 

Elastie  modulus 

1992.3 

1881.9 

P 

Porosity 

0.780 

0.789 

BMD  (g/em^) 

Bone  mineral  density 

0.4400 

0.4215 

e(10-") 

Mierostrain 

501.9 

473.4 

0(10'®) 

Loading  potential 

1.904 

1.507 

D  (mm/mm^) 

Total  eraek  length  per 
seetion  area 

0.0375 

0.0327 

by  (mm/mm^/day) 

Damage  formation  rate 

0.0000353 

0.0000280 

bn  (mm^mm^/day) 

Damage  removal  rate 

0.0000353 

0.0000417 

X  (BMUs/mmVday) 

BMUs  appearing  in  the 
seetion  area  per  day 

0.0133 

0.0180 

Ny  (#/mm^) 

Number  of  refilling  sites 

0.8495 

1.2825 

Nn  (#/mm^) 

Number  of  resorbing  sites 

0.3318 

0.4483 
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Table  2.2.  Remodeling  simulation  constants. 


Constant  (units) 

Description 

Nominal 

value 

Source 

/t/r(nim^) 

Area  of  formation 

1.418  X  10'' 

[23] 

Ar  (mm^) 

Area  of  resorption 

1.418  X  10-^ 

[23] 

ARa.2)  (mm^) 

Area  of  resorption  (reduced  by  1/6) 

1.181  X  10-^ 

[23] 

Ar),.})  (mm^) 

Area  of  resorption  (reduced  by  3/13) 

1.090  X  10-^ 

[23] 

Tr  (days) 

Resorption  period 

25 

[23] 

T,  (days) 

Reversal  period 

5 

[23] 

7>  (days) 

Refilling  period 

64 

[23] 

ko  (mm/mm^) 

Damage  rate  coefficient 

-1.85  X  lO’ 

[18] 

/?i(cpd) 

Loading  rate 

3000 

[18] 

9 

Damage  rate  exponent 

4 

[47] 

Fs 

Damage  removal  specificity  factor 

5 

[44] 

Do  (mm/mm^) 

Initial  damage 

0.0366294 

[  14,48] 

fao  (BMUs/mmVday) 

Initial  BMU  activation  frequency 

0.0067 

[49] 

00  (cpd) 

Initial  mechanical  stimulus 

1.875  X  10''“ 

[18] 

Oe  (MPa) 

Stress  applied  on  earth 

1 

Gs  (MPa) 

Stress  applied  in  space 

0.8909 

fa(max) 

(BMUs/mmVday) 

Maximum  BMU  activation  frequency 

0.5 

[18] 

^A(mca) 

Max.  specific  surface  area,  normalizing  constant 

4.195 

[18] 

^ft(cpd') 

Activation  frequency  dose-response  coefficient 

6.5  X  10'“ 

[18] 

K  (cpd) 

Activation  frequency  dose-response  coefficient 

9.4  X  10  " 

[18] 

K 

Activation  frequency  dose-response  coefficient 

-1.6 

[18] 
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Figure  2.1.  Trabecular  volume  and  cross-section  |23|. 


2.6  Simulation  of  Spaceflight 

Microgravity  was  simulated  by  lowering  the  stress  applied  to  the  bone  volume. 
Astronauts  experieneed  an  average  vertebral  trabeeular  BMD  loss  of  0.7%  per  month,  for 
a  total  of  4.2%  BMD  loss  during  the  1 80-day  average  ISS  missions  [3,5,6].  For  this 
simulation,  stress  applied  to  the  representative  volume  during  spaceflight  was  then 
determined  as  0.8909  MPa  based  on  this  180-day  spaeeflight  ending  density  of  0.42 15 
g/em^. 

Using  the  density  loss  values  at  180  days  as  a  baseline,  various  durations  of 
spaeeflight  were  simulated  based  on  typieal  mission  length  for  astronauts,  ineluding  10 
days,  90  days,  and  180  days  [5,4],  Though  365  days  in  space  is  not  typical,  it  was  also 
simulated  to  examine  the  potential  of  bisphosphonates  to  maintain  BMD  without 
inereasing  damage. 

2.7  Simulation  of  Bisphosphonates 

Bisphosphonate  treatment  was  simulated  using  two  factors;  one  lowering 
activation  frequency  and  the  other  reducing  the  resorption  area.  A  potency  variable  (P), 
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where  0  <P  <  1 ,  is  applied  to  exert  the  former  effect  by  multiplying/,  by  the  quantity  (1 
-  P).  P  is  based  on  pharmacokinetic  properties  of  bisphosphonates,  including  potency 
factors,  binding,  uptake,  and  mode  of  action  [23], 

P  =  P^y.{\-e^^’'^).  (18) 

Pmax  and  Tsare  suppression  coefficients  reflecting  various  properties  of  bisphosphonates 
in  order  to  model  a  range  of  drug  potencies.  Values  for  these  coefficients  (Table  2.3) 
were  selected  based  on  the  experimental  results  from  1  year  studies  of  daily  alendronate 
and  daily  pamidronate  treatment,  and  modeled  the  variations  in  the  reduction  of 
activation  frequency  as  seen  in  these  studies  [23].  Figure  2.2  displays  the  effects  of  the 
coefficients  on  the  relationship  between  P  and  Nr. 


Table  2.3.  Bisphosphonate  effects  analyzed  during  the  simulation. 


Treatment 

Label 

Level  of 
suppression 

 Pmax 

Initial 

bone 

balance 

no  treatment 

P0a1 

- 

0 

0 

1 

A 

P07t5a12 

Low 

0.7 

5 

1.2 

B 

P07t20a12 

Intermediate 

0.7 

20 

1.2 

C 

P1t5a12 

1.0 

5 

1.2 

D 

P1t20a12 

High 

1.0 

20 

1.2 

E 

P07t5a13 

Low 

0.7 

5 

1.3 

F 

P07t20a13 

Intermediate 

0.7 

20 

1.3 

G 

P1t5a13 

1.0 

5 

1.3 

H 

P1t20a13 

High 

1.0 

20 

1.3 
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The  size  of  the  resorption  cavity  is  reduced  during  bisphosphonate  treatment  due 
to  their  effects  on  osteoclasts  [23],  resulting  in  alterations  to  the  ratio  of  bone  area  formed 
to  bone  area  removed.  Two  different  initial  bone  balance  ratios  {AfIAr)  for  the  simulation 
of  bisphosphonate  treatment  were  used  (Table  2)  based  on  reductions  of  1/6  and  3/13  to 
resorption  area  found  in  postmenopausal  women  treated  with  bisphosphonates  for  1  year 
[23],  A  bone  balance  of  1 .0  is  assumed  for  the  simulation  when  bisphosphonate  treatment 
is  not  in  effect. 

Bisphosphonates  were  simulated  during  the  entire  spaceflight.  Preflight  treatment 
was  also  examined,  where  bisphosphonates  were  applied  to  the  simulation  at  0,  7,  14,  30, 
90,  and  180  days  pre flight. 
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2.8  Simulation  of  Return  to  Earth 


The  return  to  earth  was  modeled  by  resuming  preflight  bone  loading  conditions, 
with  an  applied  stress  of  1  MPa.  Once  back  on  Earth,  bisphosphonate  therapy  was 
discontinued.  The  simulation  was  extended  365  days  postflight  to  examine  increases  or 
decreases  in  fracture  risk  based  on  bone  mineral  density  and  damage  accumulation. 
Though  it  takes  1  to  3  years  to  fully  recover  without  treatment,  a  one  year  postflight 
examination  allowed  us  to  determine  if  a  treatment  is  successful  at  maintaining  bone 
mass  without  accumulating  more  damage.  A  successful  treatment  will  cause  the 
remodeling  properties  to  reach  new  equilibrium  values  within  one  complete  remodeling 
cycle  (3  to  4  months)  after  arriving  back  on  Earth. 

2.9  Model  Implementation 

The  computational  model  was  coded  in  MATLAB  (Appendix  A).  The  time 
increment  for  which  all  the  model  variables  were  updated  and  tracked  was  1  day.  The 
computational  simulation  was  executed  in  Windows  Vista  (32-bit)  using  an  Intel  Core  2 
Duo  processor. 

2.10  Postflight  Parameter  Analysis 

Together,  bone  mass  (quantity)  and  bone  quality  determine  the  ability  of  bone  to 
resist  fracture  [50,51].  For  this  simulation,  we  examined  changes  in  bone  mass  and  bone 
quality  in  terms  of  BMD  and  microdamage  accumulation,  respectively.  Experimental 
results  from  ex  vivo  studies  have  shown  BMD  to  predict  66  to  74  percent  of  the  variation 
in  bone  strength  [52].  An  increase  in  bone  mass  and  bone  quality  will  lead  to  stronger. 
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more  fracture  resistant  bone;  thus,  in  the  analysis  we  assumed  higher  BMD  and  lower 
damage  accumulation  to  lead  to  higher  fracture  resistance. 
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CHAPTER  3:  RESULTS 


3.1  Untreated  Spaceflight 

The  model’s  results  were  eonsistent  with  experimental  data  obtained  from 
spaeeflight  [4]  in  that  the  predieted  BMD  loss  was  non-linear  (Figure  3.1).  Predieted 
damage  accumulation  decreased  as  flight  duration  increased  (Figure  3.1)  due  to  the 
disuse  response  in  which  damage  was  specifically  targeted  during  resorption  and  because 
less  damage  formed  each  day  due  to  the  microgravity  environment  (Figure  D25).  The 
predicted  rate  of  BMD  loss  was  greatest  early  on  in  the  flight,  showing  smaller 
decrements  as  time  spent  in  space  increased.  The  model  predicted  little  BMD  loss  and 
change  from  preflight  damage  for  the  typical  flight  duration  of  10  days  (Figure  3.1); 
however,  postflight  predictions  showed  that  BMD  continued  to  decrease  upon  return  to 
Earth  until  it  reached  a  value  nearly  3  times  lower  than  it  was  at  the  end  of  the  mission 
before  increasing  to  near  normal  levels  about  100  days  after  entering  Earth’s  gravity 
(Figure  Bl). 
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Figure  3.1.  Predicted  percent  decreases  in  BMD  and  damage  (D)  of  untreated  bone  at  end  of 
spaceflight. 
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Figure  3.2.  Predicted  effects  of  180-day  spaceflight  on  BMD  of  untreated  bone  from  beginning  of 
flight  through  19.5  years  postflight. 
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Figure  3.3.  Predicted  effects  of  180-day  spaceflight  on  damage  accumulation  (D)  of  untreated  bone 
from  beginning  of  flight  through  19.5  years  postflight. 


For  the  1 80-day  space  mission,  the  predicted  postflight  results  for  untreated  bone 
showed  sharp  increases  to  both  BMD  and  damage  upon  return  to  Earth  (Figures  3.2  and 
3.3).  BMD  reached  equilibrium  approximately  7  years  postflight,  and  was  about  2.7% 
less  than  its  preflight  value.  Damage  continued  to  accumulate  postflight  until  equilibrium 
was  reached  about  1 5  years  after  the  return  to  Earth.  Though  damage  was  initially  lower 
upon  return  to  earth,  it  continued  to  increase  postflight  until  reaching  a  value 
approximately  9.5%  higher  than  its  preflight  value.  Figures  3.2  and  3.3  clearly  indicate  a 
need  for  treatment  as  bone  was  negatively  affected  by  decreased  mass  and  quality. 

Also  noteworthy  is  the  predicted  oscillatory  behavior  of  BMD  values  seen  in 
disuse  (Figures  3.2  and  3.15)  for  untreated  bone.  The  inflection  points  are  located 
approximately  at  the  same  intervals  as  the  transitions  from  resorption  to  refilling  and 
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refilling  back  to  resorption  in  the  BMU  remodeling  period.  This  oseillatory  trend  was 
also  noted  in  the  model  by  Hazelwood  et  al.  [18]  and  still  needs  further  investigation. 

3.2  Bisphosphonate  Treatment  Onset  at  Beginning  of  Spaceflight 

The  simulation  predieted  gains  in  BMD  for  shorter  flights  (10  and  90  days)  in 
which  treatments  exhibited  intermediate  to  high  suppression  (Figures  3.4  and  3.5).  For  all 
flight  durations,  high  suppression  of  BMU  aetivation  (Table  2.3)  led  the  model  to  prediet 
increases  in  both  BMD  and  damage  aeeumulation.  Overall,  the  model  predieted 
treatments  ereating  bone  balanees  of  1.3  to  have  more  positive  effeets  on  BMD  (i.e.  less 
loss  or  greater  inerease).  Although  those  with  bone  balanees  of  1 .3  positively  affeeted 
BMD,  the  model  predieted  that  they  also  caused  more  damage  to  accumulate  when  the 
level  of  remodeling  suppression  was  high.  In  general,  the  model  predicted  treatments 
with  intermediate  levels  of  suppression  to  have  smaller  changes  in  BMD  at  the  end  of 
spaceflight  than  the  decreases  predicted  with  low  levels  of  suppression  and  than  the 
increases  predicted  with  high  levels  of  suppression.  Also,  the  simulation  predicted  that 
treatments  with  intermediate  suppression  caused  end-of-flight  BMD  and  damage 
accumulation  values  of  to  remain  closer  to  the  pretreatment,  preflight  values  than 
treatments  with  low  or  high  remodeling  suppression. 

As  flight  duration  increased,  predicted  percent  changes  in  damage  and  BMD 
increased.  Simulations  of  long  flight  durations  (180  and  365  days)  resulted  in  significant 
changes,  predicting  treatments  with  low  and  intermediate  suppression  to  have  significant 
decreases  in  damage  (up  to  14.5%)  similar  to  untreated  bone.  The  greatest  predicted 
increases  in  both  damage  and  BMD  occurred  for  treatments  of  high  suppression  and  bone 
balances  of  1.3.  Simulation  of  treatments  C,  E,  F,  and  G  (Plt5al2,  P07t5al3,  P07t20al3, 


26 


Change  from  Pretreatment  Value  (%) 


and  Plt5al3),  with  low  and  intermediate  levels  of  remodeling  suppression,  showed 
increases  in  BMD  and  decreases  in  damage  accumulation  on  longer  duration  spaceflights 
(Figures  3.6  and  3.7). 
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Figure  3.4.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  10-day  spaceflight. 
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Figure  3.5.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  90-day  spaceflight. 

7.5 


Figure  3.6.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  180-day  spaceflight. 
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Bisphosphonate  Treatment  Given  at  Beginning  of  Flight  (at  t  ^O) 

Figure  3.7.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  365-day  spaceflight. 

3.3  Preflight  Bisphosphonate  Treatment 

In  accordance  with  data  obtained  from  clinical  studies  [21],  the  predicted  results 
of  bisphosphonate  treatment  on  Earth  exhibited  increases  in  BMD  and  damage 
accumulation.  Predicted  pre-spaceflight  additions  to  BMD  and  damage  continued  to  rise 
as  the  duration  of  the  preflight  therapy  simulation  increased  from  7  to  180  days  (Figures 
3.8-3. 12).  The  model  showed  damage  to  increase  at  a  faster  rate  than  BMD.  The  ratio  of 
percent  increase  in  damage  to  percent  increase  in  BMD,  used  in  this  study  as  a  measure 
indicating  efficiency  of  reducing  fracture  risk  in  which  a  lower  value  is  more  optimal, 
was  highest  for  treatments  with  high  levels  of  remodeling  suppression,  and  especially  for 
those  also  with  lower  bone  balances  (Table  3.1).  The  lowest  ratio  of  percent  preflight 
increase  of  damage  to  BMD  was  predicted  for  Treatment  E  (P07t5al3),  which  modeled 
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Change  from  Pretreatment  Value  (%) 


low  remodeling  suppression  and  a  bone  balanee  ratio  of  1.3.  Bisphosphonate  treatments 
with  lower  suppression  of  BMU  activation  and  higher  bone  balance  ratios  proved  to  be 
optimal  by  adding  more  healthy  bone  per  increase  in  BMD. 
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Figure  3.8.  Predicted  preflight  increase  in  BMD  and  damage  (D)  due  to  7-day  preflight  treatment. 
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Figure  3.9.  Predicted  preflight  increase  in  BMD  and  damage  (D)  due  to  14-day  preflight  treatment. 
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Figure  3.10.  Predicted  preflight  increase  in  BMD  and  damage  (D)  due  to  30-day  preflight  treatment. 
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ure  3.1 1.  Predicted  preflight  increase  in  BMD  and  damage  (D)  due  to  90-day  preflight  treatment. 
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Figure  3.12.  Predicted  preflight  increase  in  BMD  and  damage  (D)  due  to  180-day  preflight  treatment. 


32 


Table  3.1.  Ratio  of  percent  preflight  increase  of  damage  (D)  to  BMP. 


%AD:%ABMD  for  Number  of  Days  of  Preflight  Treatment 
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3.4  Varying  Onset  of  Bisphosphonate  Treatment  for  Spaceflight 

For  longer  durations  in  space,  the  model  predicted  pretreatment  periods  to  become 
less  effective  at  influencing  the  end-of-flight  values  for  BMD  and  damage  (Figure  3.7, 
3.13,  and  3.14).  As  duration  in  space  increased,  the  model  predicted  end-of-flight  values 
to  be  influenced  more  by  the  effects  of  spaceflight  than  the  effects  of  preflight  treatment. 
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Figure  3.13.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  365-day  spaceflight  due  to 
30-day  preflight  treatment. 
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Figure  3.14.  Predicted  percent  changes  in  BMD  and  damage  (D)  at  end  of  365-day  spaceflight  due  to 
180-day  preflight  treatment. 

Alternately,  pretreatment  phases  highly  influenced  the  model's  predictions  of  BMD  and 
damage  for  shorter  durations  of  spaceflight.  For  nearly  all  bisphosphonate  potencies 
simulated,  the  addition  of  preflight  treatment  caused  increased  BMD  and  damage 
accumulation  at  the  end  of  10-day  spaceflight.  For  90-day  spaceflight,  a  pretreatment 
period  of  30  days  predicted  increases  in  BMD  without  significantly  increasing  damage, 
and  the  same  occurred  with  a  90-day  pretreatment  for  180-day  spaceflight.  Also,  adding 
preflight  treatment  for  therapies  with  high  suppression  predicted  further  increases  to  the 
already  large  gains  in  BMD  and  damage  that  occurred  without  pretreatment. 

3.5  One-Year  Postflight,  Posttreatment  Recovery 

The  model  predicted  treatments  with  low  levels  of  remodeling  suppression  given 
initially  at  the  beginning  of  spaceflight  to  result  in  the  highest  BMD  and  lowest 
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microcrack  density  accumulation  1-year  after  returning  to  Earth  (which  is  also  1-year 
posttreatment).  Treatments  with  high  suppression,  though  they  resulted  in  higher  BMD  at 
the  end  of  flight,  were  predicted  to  generate  the  lowest  BMD  of  all  the  applied  treatments. 
Predicted  1-year  postflight  values  for  BMD  and  damage  for  treatments  with  intermediate 
levels  of  remodeling  suppression  were  between  the  two  extremes  (Figures  3.15  and  3.16). 
Note  that  bisphosphonate  treatment  begins  where  the  x-  and  y-axes  meet  for  the  line 
graphs  that  display  timelines  of  preflight  through  1-year  postflight  predicted  values. 
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Figure  3.15.  Predicted  bisphosphonate  effects  on  BIMD  and  posttreatment  return  to  Earth  from  180- 
day  spaceflight. 
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Figure  3.16.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  180- 
day  spaceflight. 


Upon  return  to  Earth,  predicted  damage  accumulation  increased  for  treatments 
given  at  the  beginning  of  spaceflight  that  created  bone  balances  of  1 .2  (Figure  3.17).  This 
was  the  opposite  case  for  bone  balances  of  1.3,  where  the  model  predicted  further 
decreases  in  damage  post-flight  and  post-treatment  (Figure  3.18),  except  in  the  case  of 
365-day  spaceflight  where  predicted  damage  loss  was  substantial  during  flight  (Figure 
3.19).  Prediction  results  for  treatments  with  high  levels  of  remodeling  suppression  did  not 
follow  these  trends,  as  they  always  led  to  decreases  in  damage  during  postflight  recovery. 
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Figure  3.17.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  180-day  spaceflight. 
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Figure  3.18.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  180-day  spaceflight. 
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Figure  3.19.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  365-day  spaceflight. 


The  predicted  gains  in  BMD  due  to  preflight  treatment  appear  to  have  increased 
the  ability  to  recover  from  spaceflight  as  predicted  BMD  and  damage  nearly  reach 
pretreatment  values  (Figures  3.20  and  3.21  for  bisphosphonates  given  90  days  preflight. 
See  appendices  B,  C,  D,  and  E  for  treatment  results  for  10-,  90-,  180-,  and  365-day 
spaceflights,  respectively.).  Most  of  the  predicted  values  for  BMD  and  damage  either 
were  near  or  reached  equilibrium  after  1-year  of  postflight  recovery.  The  model  predicted 
1-year  postflight  recovery  values  for  BMD  and  damage  to  be  both  above  and  below 
pretreatment  values,  depending  on  the  treatment. 
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Figure  3.20.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  180-day  spaceflight. 


Figure  3.21.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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CHAPTER  4:  DISCUSSION 


The  computer  model  developed  here  combines  previous  bone  remodeling  and 
bisphosphonate  algorithms  plus  spaceflight  data  obtained  from  experimental  studies  in 
literature  in  order  to  better  understand  the  adverse  effects  of  microgravity  on  bone  and 
predict  potential  treatments  for  space  explorers.  The  model  predicted  reduced  risk  of 
fracture  by  increasing  bone  quantity  and  either  increasing  or  only  slightly  reducing  bone 
quality  for  treatments  (1)  with  low  to  intermediate  suppression  of  remodeling  activation 
and  (2)  that  create  higher  bone  balance  ratios.  The  simulation  also  predicted  significant 
changes  to  BMD  and  damage  upon  return  to  Earth  as  the  remodeling  response  readjusted 
to  higher  stress  conditions.  For  treatments  highly  suppressing  remodeling  activation, 
these  predicted  postflight  changes  included  decreased  BMD  and  increased  damage 
accumulation.  Low  levels  of  remodeling  suppression  led  the  model  to  predict  substantial 
increases  in  BMD  and  small  increases  in  damage  postflight.  Postflight  changes  were 
minimal  for  treatments  with  intermediate  suppression. 

The  model  was  developed  to  match  the  4.2  percent  loss  in  BMD  over  1 80  days  in 
space  as  seen  on  the  International  Space  Station  [3,5,6].  The  model’s  greatest  predicted 
BMD  loss  in  untreated,  trabecular  vertebral  bone  was  5.01  percent  for  a  365-day 
spaceflight.  This  is  less  than  half  the  highest  loss  (-10.8  percent)  seen  in  Russian 
cosmonauts  on  Salyut  missions  lasting  5  to  7  months  [5].  Though  the  model  does  not 
match  the  results  from  these  older  missions,  it  is  likely  due  to  advancements  in 
technology,  physical  preparedness  of  subjects,  and  onboard  exercise  routines  that  were 
developed  for  missions  to  the  International  Space  Station. 
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Full  recovery  for  space  explorers  returning  from  the  ISS  took  from  1  to  3  years  to 
complete  [5].  The  model  developed  here  predicted  that  full  recovery  to  preflight  BMD 
values  may  never  be  attained  without  treatment.  With  bisphosphonate  treatment,  the 
model  predicted  complete  recovery  to  occur;  some  treatments  even  resulted  in  higher 
BMD  values  than  existed  preflight.  The  model  suggests  that  bisphosphonate  treatment, 
combined  with  exercise,  may  be  the  solution  that  NASA  and  other  space  exploration 
programs  desire  to  combat  bone  deterioration  in  space. 

The  predicted  remodeling  response  of  untreated  bone  to  environmental  changes 
was  non-linear,  as  most  BMD  was  lost  or  gained  early  on  in  the  transitions  from  Earth  to 
space  and  space  to  Earth.  For  1 0  days  in  space,  the  model  predicted  more  mineral  to  be 
lost  while  readjusting  to  Earth’s  gravity  than  lost  during  spaceflight.  This  has  yet  to  be 
examined  experimentally,  but  certainly  the  model  provided  insight  into  a  possible  trend 
that  may  have  gone  unnoticed.  Knowing  when  fracture  risk  is  maximized  may  provide 
for  better  postflight  recovery  programs  so  that  fracture  can  be  avoided. 

The  model  predicted  bisphosphonate  treatment  to  be  beneficial  for  all  durations  of 
spaceflight,  not  just  for  longer  duration  missions.  In  many  instances,  preflight  treatments 
were  shown  to  reduce  the  fracture  risk  upon  return  to  Earth.  Longer  simulated  flight 
durations  required  longer  preflight  treatments  to  provide  similar  effects  to  those  with 
shorter  flights  and  shorter  pretreatments.  The  problem  with  this  is  that  as  treatment  on 
Earth  is  lengthened,  damage  accumulation  increases  to  such  an  extent  that  it  could 
actually  cause  an  increase  in  fracture  risk  before  entering  space.  Based  on  the  model’s 
predictions  of  damage  increase,  pretreatment  periods  longer  than  30  days  may  put  the 
subjects  at  risk.  During  pretreatment,  the  subjects  are  still  on  Earth  where  higher  stresses 
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cause  greater  inereases  in  damage  as  eompared  to  spaee.  They  may  also  be  exposed  to 
even  higher  stresses  due  to  exereises  in  preparation  for  the  mission.  These  exereises, 
eombined  with  brittler  bones,  could  lead  to  a  fraeture  before  flight  and  put  a  hold  on  the 
mission. 

Most  interestingly,  the  model  predicted  treatments  with  high  suppression  of 
remodeling  aetivation  to  have  the  highest  gain  in  BMD  at  the  end  of  flight,  and  the  lowest 
BMD  values  1-year  postflight.  These  treatments  almost  completely  inhibited  remodeling, 
eausing  large  amounts  of  damage  to  accumulate.  Though  BMD  was  mueh  higher,  the 
quality  of  bone  was  poor.  Upon  return  to  earth  and  diseontinuation  of  treatment,  bone 
remodeling  was  no  longer  inhibited  and  responded  to  the  high  amount  of  damage. 
Damage  and  bone  were  removed  at  a  mueh  greater  rate  than  bone  formation  occurred, 
causing  quality  of  bone  to  increase,  but  quantity  to  decrease. 

Alternately,  the  model  predicted  treatments  with  low  suppression  of  aetivation 
frequency  to  have  the  lowest  BMD  at  the  end  of  spaceflight,  but  they  had  the  highest 
BMD  and  lowest  amount  of  damage  1-year  postflight.  These  treatments  allowed  a  fair 
amount  of  remodeling  to  continue  in  spaee,  but  limited  it  enough  so  that  bone  loss  was 
kept  to  a  minimal  amount.  A  majority  of  the  predicted  bone  loss  came  from  lost  damage, 
so  upon  return  to  earth  damage  accumulation  did  not  activate  a  remodeling  response. 
These  treatments  had  the  largest  postflight  gains  in  BMD  because  the  response  was 
mostly  due  to  loading  in  which  bone  was  added  to  meet  the  strength  required  to  support 
the  subject. 

Treatments  with  intermediate  suppression  and  bone  balance  ratios  of  1 .3  were 
optimal  for  both  end-of-flight  and  1-year  postflight.  The  model  predicted  these  treatments 
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to  lower  risk  of  fracture  both  upon  return  to  Earth  and  after  1  year  of  recovery.  Lower 
levels  of  suppression  allowed  just  enough  resorption  to  remove  a  good  amount  of  fatigue 
microdamage  and  increase  bone  quality,  while  higher  bone  balances  appropriated  more 
formation  than  resorption,  increasing  bone  mass. 

Since  the  simulation  of  bisphosphonate  treatment  in  this  model  was  short  in 
comparison  with  other  models,  it  is  difficult  to  determine  if  limits  of  BMD  growth  were 
reached.  Predicted  BMD  gains  were  non-linear  and  fluctuated  throughout  the  simulation; 
in  contrast,  previous  models  that  did  not  account  for  damage  and  disuse  stimuli  showed 
only  permanent,  linear  gain  in  mass  [32,33,34]. 

Similar  to  Lacy’s  model  of  trabecular  bone  turnover  [34],  activation  frequency 
was  found  to  have  the  greatest  effect  on  bone  mass.  Unloading  in  microgravity  caused  a 
disuse  response  in  untreated  bone,  increasing  BMU  activation  and  leading  to  the 
resorption  of  large  amounts  of  bone.  The  model  by  Hernandez  et  al.  [33]  also  showed 
similar  results  in  that  the  initial  gain  in  bone  mass  was  dependent  upon  the  level  of 
remodeling  suppression  and  bone  balance  ratio.  Heaney’s  model  [32]  exhibited  an  initial 
gain  dependent  upon  the  pretreatment  remodeling  parameters;  however  this  model  did 
not  examine  variations  in  these  parameters  before  treatment. 

It  is  difficult  to  compare  the  accumulation  of  damage  of  this  model  to  others  since 
it  also  simulates  microgravity.  The  model  by  Nyman  et  al.  [23]  predicted  small  gains  in 
microdamage  initially  that  were  proportional  to  activation  frequency  suppression.  In 
contrast,  the  model  developed  here  predicted  losses  in  microdamage  for  treatments  with 
low  and  intermediate  levels  of  suppression  and  gains  in  damage  accumulation  when 
activation  frequency  was  highly  suppressed. 
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The  limitations  of  this  model  occur  where  assumptions  have  been  made  due  to  the 
lack  of  available  information.  First,  the  damage  rate  coefficient,  ko,  was  kept  constant 
throughout  the  simulation,  though  it  is  likely  to  change  in  space  or  for  various  bone 
balances.  Other  coefficients,  too,  such  as  the  damage  rate  exponent  or  the  activation 
frequency  coefficients,  are  likely  to  be  altered  in  space  and  would  benefit  from  further 
study  of  bone  remodeling  in  microgravity.  Second,  the  predicted  postflight  results  are 
limited  by  the  fact  that  they  are  based  on  the  same  stress  applied  preflight  even  though 
postflight  recovery  programs  enable  space  explorers  to  ease  back  into  full  loading.  This 
high  postflight  stress  would  cause  ovcrpredictions  of  both  BMD  and  damage.  Also,  a 
bone  balance  ratio  of  1 .0  was  instantly  applied  upon  return  to  Earth,  when  it  is  more 
likely  that  the  ratio  would  slowly  ease  back  down.  Third,  the  simulation  applies  a 
constant  stress  derived  from  bone  loss  to  a  section  of  bone  rather  than  deriving  the  actual 
strain  and  applying  it  to  a  finite  element  model.  Using  a  finite  clement  model  would 
create  a  more  accurate  remodeling  response  with  more  precise  loading  conditions  and 
allow  detailed  analysis  of  the  effects  of  specific  exercises  on  maintaining  bone  mass. 
Lastly,  the  model  docs  not  take  into  account  effects  of  spaceflight  on  blood  flow,  drug 
metabolism,  tissue  binding,  drug  elimination,  fluid  shear  stress,  or  changes  in  hormone 
levels  [2,4],  Many  of  these  affect  the  efficacy  of  the  drug  itself  Changes  to  fluid  shear 
stress  in  a  microgravity  environment  could  affect  the  mechanosensory  ability  of 
osteoclasts  to  sense  signals  indicating  bone  loading  and  would  lead  to  further  loss  of  bone 
even  under  heavy  exercise  [4].  Also,  although  the  model  tracks  changes  to  the 
populations  of  osteoblasts  and  osteoelasts,  it  only  accounts  for  changes  due  to  the 
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remodeling  response  and  not  due  to  the  physiological  adaptations  that  may  occur  in 
microgravity  [2]. 

Changes  in  hormone  levels  or  physiological  alterations  to  the  populations  of 
osteoblasts  or  osteoclasts  could  significantly  alter  the  remodeling  response  in  space  and 
the  response  to  bisphosphonate  treatment  [4],  With  reduced  levels  of  PTH,  IGF-1,  and 
growth  hormone  [4],  it  would  be  likely  for  remodeling  formation  and  resorption  rates  to 
be  altered  in  microgravity.  With  so  little  bone  formation  occurring,  it  could  also  be 
possible  that  active  osteoclasts  may  significantly  outnumber  osteoblasts  and  lead  to  a 
slower  recovery  response  upon  return  to  earth. 

It  is  clear  that  the  model  would  significantly  benefit  from  further  studies  on 
spaceflight.  Though  the  model  has  to  overcome  the  many  unknown  variables  of  bone 
remodeling,  bisphosphonates,  and  microgravity,  it  has  shown  the  ability  to  provide 
potential  trends  for  future  studies.  As  new  data  and  information  becomes  available,  the 
model’s  accuracy  can  only  be  improved  and  could  eventually  be  a  tool  used  for 
predicting  effects  of  other  treatments  as  well. 
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SUMMARY  OF  CONCLUSIONS 


•  The  model  predieted  bisphosphonates  reduced  fracture  risk  by  increasing  bone 
quantity  and  either  increasing  or  only  slightly  reducing  bone  quality  for 
treatments; 

•  ( 1 )  with  low  to  intermediate  suppression  of  remodeling  activation 

•  (2)  that  create  higher  bone  balance  ratios 

•  Most  changes  to  BMD  occurred  early  on  when  adjusting  to  new  environments 

•  Predicted  BMD  loss  was  fairly  consistent  with  data  from  missions  to  the 
International  Space  Station 

•  Preflight  treatments  were  shown  to  reduce  the  risk  of  fracture  for  all  durations  of 
spaceflight 

•  Longer  preflight  treatment  periods  may  put  the  subject  at  risk  due  to  increased 
microdamage  accumulation 

•  Overall,  the  model  suggested  that  bisphosphonate  treatment,  combined  with 
existing  exercise  programs,  may  be  the  solution  to  combat  bone  deterioration  in 
space 
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APPENDIX  A:  MATLAB  CODE 


%Bone  Mass  Preservation  and  Fracture  Risk  Assessment 
%with  Bisphosphonate  Therapy  During  Spaceflight 

%Simulation  of  Bisphosphonates  acting  on  Bone  Remodeling  in  Space 
%Chris  Gardina  6-10-08 
% 

clear 

clc 


%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%  Remodeling  parameters 


Rc  =  0.095; 

Rh  =  0.020; 

Tr  =  25; 

Tv  =  5; 

Tf  =  64; 

trabl  =  0.2; 

to  trabecular  bone; 


%  Cement  line  radius 
%  Haversian  canal  radius 
%  Resorption  period 
%  Reversal  period 
%  Formation  period 
%  Porosity  partition  for  cortical 
Change  resorption  area  &  Disuse 


trab2  =  0.097267787;  %  Porosity  partition  for  cortical 

to  trabecular  bone:  Change  in  stiffness  constants 

phiO  =  0.0000000001875;  %  Equilibrium  stimulus 

%por0  =  0.2;  %  Initial  trabecular  porosity 

porO  =  0.04432132964;  %  Initial  cortical  porosity 

saO  =  ((((28.8*por0-101)*por0+134)*por0-93.9)*por0+32.1)*por0;  % 

Initial  surface  area 

phc=0 . 04432132 964 ;  %  Adjusts  resorption  rate  to  match 

apposition  rate  for  cortical  bone  (i.e., 

%  assumes  resorption  process 

includes  void  spaces) 


%  Activation  frequency  conditions 
%  Describes  Ac . f  versus  disuse  and  Ac . f 
Ac f maxi  =  0.5; 

Acfmax2  =  0.5; 
samax  =  4.1905; 

AcfdisO  =  0.0; 

AcfdamO  =  0.0224693284; 

AcfO  =  (AcfdamO  +  AcfdisO ) *sa0/samax; 
kb  =  65000000000; 
kc  =  phiO/2; 


versus  damage  curves 
%  Maximum  Ac . f  due  to  damage 
%  Maximum  Ac . f  due  to  disuse 
%  Normalizes  specific  area 
%  Equilibrium  Ac . f  for  disuse 
%  Equilibrium  Ac . f  for  damage 
%  Equilibrium  Ac . f 


%  Damage  conditions 

fs  =  5;  %  Damage  repair  factor 

dO  =  0.03662944;  %  Equilibrium  damage 

if  porO  <=  trabl 

kd  =  dO *Acf 0 * (pi *Rc^2 ) * f s/phiO ;  %  Equilibrium  damage  constant 

else 

kd  =  0 . 5'*'dO'*'Acf  O’^  (pi '*'Rc'^2 )  *f  s/phiO  ; 

end 


kr  =  -1.6; 

%  Mechanical  conditions 

Area  =  100;  %  Cross-sectional  area  of  bone 
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rll  =  3000; 
cycles  per  day 
q  =  4; 
change  =  0/ 
chgper  =  1; 
days  =  7300; 

Setup 

flight  =  180; 
postflight  =  7300; 
dt  =  1; 


-  Frequency  of  loading  In  no.  of 

I-  exponent  of  mechanical  stimulus 
c  percent  change  in  force 

%  time  period  of  force  change 

%  Time  xength  of  initial  value 

%  Time  length  of  spaceflight 

“  Time  length  of  return  to  earth 
Time  step;  One  day 


%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%% 

%Loop  through  values  of  tau,  Pmax,  and  bone  baiance 
".%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%%%% 

for  x=l : 3 

if  (x  ==  1) 

Pmax=0 ; 

end 

if  (X  ==  2) 

Pmax=0 . 7 ; 

end 

if  (x  ==  3) 

Pmax  =  1; 

end 

for  y=l:2 

if  (y  ==  1) 
tau=5; 

end 

if  (y  ==  2) 
tau=20; 

end 

for  z=l:2 

if  (z  ==  1) 

area_r_rat io=5 . / 6 ;  %bone  balance  1.2 

end 

if  (z  ==  2) 

area_r_rat io=10 . / 13 ;  %bone  balance  1.3 

end 

if  Pmax  ==  0 

area_r_ratio=l ;  '%no  drug  therapy, 

bone  balance  ^ 
end 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
^0  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%!%%%%%%%%  %%%%%%%%% 
1  Prior  conditions  before  start  of  simulation 

for  t=l : (Tr+Tv+Tf ) 

por(t)  =  porO;  i  porosity 

if  por(t)  <=  trab2 

modulus(t)  =  234  4  0*  ( 1-por  ( t )  )  “^5 . 74  ;  %Stiffness 

of  bone  if  cortical 
else 

modulus(t)  =  14927*  (1-por  (t)  ) '^l .  33;  %Stiffness 

of  bone  if  trabecular 
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end 


Phi  (t)  =  phiO; 

mechanical 

stimulus 

strain(t)  =  (phiO/rll ) ^0 . 25; 

% 

principal 

strain 

stress (t)  =  modulus (t) *strain (t) ; 

% 

principal 

stress 

Force (t)  =  stress (t) *Area; 

% 

force  on 

bone 

SA(t)  =  saO/samax; 

% 

normalizes 

Ac .  f 

by  available  surface  area 

Df(t)  =  kd*phiO; 

% 

damage 

formation 

rate 

Dr(t)  =  dO*AcfO* (pi*Rc^2) *fs; 

% 

damage 

removal  rate 

if  por(t)  >  trabl 

Dr (t)  =  0 . 5*Dr  (t) ; 

end 

D(t)  =  dO; 

% 

damage 

NfBMU(t)  =  AcfO*Tf; 

% 

No.  of 

refiling  BMUs 

NrBMU(t)  =  AcfO*Tr; 

% 

No .  of 

resorbing 

BMUs 

if  por(t)  <=  trabl 

Qf(t)  =  pi* (Rc^2-Rh^2) /Tf ; 

% 

mineral 

apposition 

rate 

Qr(t)  =  pi*Rc''2/Tr; 

% 

resorption 

rate 

QrNr(t)  =  (1-phc) *Qr (t) *NrBMU (t) ; 

% 

amount 

bone  removed 

QfNf(t)  =  Qf (t) *NfBMU (t) ; 

% 

amount  of 

bone  added 

else 

Qf(t)  =  0 . 5*pi*Rc^2/Tf ; 

Qr(t)  =  0.5*pi*Rc''2/Tr; 

QrNr(t)  =  Qr (t) *NrBMU (t) ; 

QfNf(t)  =  Qf (t) *NfBMU (t) ; 

end 

Qnet(t)  =  QfNf (t) -QrNr (t) ; 

% 

difference 

between  mineral  added  and  mineral  removed 

Acfdam(t)  =  AcfdamO; 

% 

Ac . f  due 

to  damage 

Acfdis (t)  =  AcfdisO; 

% 

Ac . f  due 

to  disuse 

Acf(t)  =  (Acfdam(t)  +  Acfdis (t) ) *SA  (t) ; 

% 

Total 

Ac .  f 

TIME(t)  =  t; 

end 


%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%%%%%%%% 

%%%%%%%Adding  in  Constants  for  Bisphonate 
Treatment! %%%%%%%%%%%%%%% 

%  Pmax=0.7; 

%  Pmax=l; 

%  tau=5; 
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t  ci  U  “  ^  0  ,* 

■  at ea_r_rat io=l ; 

'  area_r_rat io=b . / 6 ; 
area_r_rat  io=10  .  / 1  3 ; 
pref light_treat  =  0; 
therapy  before  spaceflight 

1  i  %  %  %  %  %  %  %  %  %  %  %  %  %  %  %  "t  %  %  %  %  %  %  °  %  %  %  %  %  i  %  %  i  ^  i  %  T 1 1  i  i  1 1 1 

^  ^  ^  ^  % 

^.^%%%%%%%%%%%%%%'^  -  o%"  ^^^  ^%^“%%%%%%%^%^ %%%%%%%%%%%%%% 

^  ^  i  i 


'rbone  balance  1 
l^bone  balance  1.2 
“^bone  balance  ^.3 
"^Days  of  Bi sphosphonate 


%  Simulation 

for  t= (Tr+Tv+Tf +1 ) : (days+f 1 ight+postf 1 ight ) 
TIME  (t)  =  t; 


°  Mechanical  conditions  upduate 
if  por(t-l)  <=  trab2 

modulus(t)  =  23440*  ( 1-por  (t-1 )) .  74  ;  -Stiffness 

of  bone  if  cortical 
else 

modulus(t)  =  14  927  *  ( 1-por  (t-1 )  )  1 . 33 ;  %Stiffness 

of  bone  if  trabecular 
end 

if  (t  >  (days))  &&  (t  <  (days  +  flight  +  1)) 

Force  (t)  =  89.09;  Force  in 

spaceflight  to  match  0.7%BMD  loss  per  month 

%Force(t)  =  85.47;  ^Force 

in  spaceflight  to  match  1.0%BMD  loss  per  month 
else 

Force (t)  =  100;  5Force 

needed  to  determine  initia^  values 
end 

stress  (t)  =  Force  (t ) /Area ;  “iStress  on 

bone 

strain  (t)  =  stress (t) /modulus (t) ;  iStrain  on 

bone 


%  Porosity  update 

Phi  (t)  =  (abs  (strain  (t)  ) '"q)  *rll  ; 

(Current  stimulus 


%Calcu  j.ate 


if  por(t-l)  <=  0.2 

area_f  =  pi*  (Rc'^2- 

Rh^2) ;  ^Formation  area  of  cortical 

line  to  Haversian  canal) 

if  (t  >  (days  -  pref light_treat ) ) 
+  flight  +  1) )  -  Bi sphosphate  treatment  period 


bone  (Cement 
&&  (t  <  (days 


area_r=area_r_ra tio*pi *Rc^2 ;  %Resorption  area  if 

cortical  &  on  Bisphosphonates 

else 

area_r  = 

pi*Rc'^2;  ^Resorption  area  if  cortical 

end 

else 
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area  f  = 


%  Formation  area  of  trabecular 


0.5*pi*Rc^2; 

bone  (half  of  osteon  area  w/o  pore) 

if  (t  >  (days  -  pref light_treat) )  &&  (t  <  (days 
+  flight  +  1))  %Bisphosphate  treatment  period 

area_r  = 

area__r_ratio*0 . 5*pi*Rc'^2 ;  %Resorption  area  if  trabecular  &  on 

Bisphosphonates 

else 

area_r  = 

0 . 5*pi*Rc'^2 ;  %Resorption  area  if  trabecular 

end 

end 

%  Calculate  change  in  damage  level  and  update 
Df(t)  =  kd*Phi(t);  %Damage 

formation  rate 

Dr(t)  =  D (t-1) *Acf (t-1) *area_r*fs;  %Damage 

removal  rate 

D(t)  =  D(t-l)  +  (Df(t)  -  Dr(t))*dt;  %Damage 

update 


%  Calculate  demand  for  new  BMUs  (Ac.f) 

Acfdam(t)  =  (Acf damO*Acfmaxl ) / (Acf damO+ (Acfmaxl- 
AcfdamO) *exp ( kr*Acfmaxl * (D ( t-1 ) -dO) /dO) ) ;  % Damage  stimulus 

if  D(t)  <=  dO 

Acfdam(t)  =  AcfdamO*D (t-1 ) /dO; 

end 

sa  =  (  (  (  (28.8*por  (t-l)-lOl)  *por  (t-l)+134)  *por  (t-D- 
93.9) *por (t-1) +32 . 1) *por (t-1) ;  % Surface  area 

Acfdis (t)  =  0;  %  No  demand  for  additional 

remodeling  if  not  in  disuse 

if  Phi ( t)  <  phiO 

Acfdis (t)  =  Acfmax2/ ( 1+exp ( kb* ( Phi ( t) - 
kc) ) ) ;  %  Demand  for  remodeling  when  bone  is  in  disuse 

end 

SA ( t ) =sa/samax; 

Acf(t)  =  (Acfdam(t)  + 

Acfdis (t) ) *SA (t) ;  %Update  Ac.f 


resorbing  BMU 

disuse 

area 


%  Calculate  daily  amount  of  bone  removed  per 
%  Include  less  refilling  on  trabecular  surfaces  in 


ac  =  area_r; 

ab  =  area_f; 

Qf(t)  =  ab/Tf; 
Qr(t)  =  ac/Tr; 


%  Resorption 
%  Formation  area 


if  por(t-l)  >  trabl 
if  Phi ( t)  <  phiO 

Qf(t)  =  (0.5  +  0.5*Phi (t) /phiO) *Qf (t) ;  % 

For  trabecular  bone,  formation  rate  decreases  in  disuse 

end 

end 
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%%%%%%%%%%%  bisphosphonate  potency  effect 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
if  (t  >  (days  -  preflight_treat) )  &&  (t  < 
^Bisphospha te  treatment  period 
P=Pmax* (1-exp (-l*tau*NrBMU (t-1) ) ) ; 

%  P=l;  %compa.etely  suppressed 
Acf(t)  =  (1-P) * (Acfdam(t)  + 

%Bisphosphonate  suppressed  activation  frequency 
end 

%  Calculate  number  of  refi^^ing  BMUs  for  current 

""  Calcuxate  number  of  resorbinq  BMUs  for  current 

NfBMU(t)  =  NfBMU(t-l)  +  (Acf (t-Tr-Tv)  -  Acf(t-Tr- 

NrBMU(t)  =  NrBMU(t-l)  +  (Acf(t)  -  Acf ( t-Tr ) ) *dt ; 

%  Calculate  net  amount  of  bone  added  per  day 
QfNf(t)  =  NfBMU (t-1) *Qf (t-1)  +  (Acf (t-Tr-Tv) *Qf (t- 
Tr-Tv)  -  Acf ( t-Tr-Tv-Tf ) *Qf ( t-Tr-Tv-Tf ) ) *dt / 

QrNr(t)  =  NrBMU ( t-1 ) *Qr ( t-1 )  +  (Acf ( t) *Qr (t )  - 
Acf (t-Tr) *Qr (t-Tr) ) *dt; 

Qnet(t)  =  QfNf (t) -QrNr (t) ; 
if  por(t-l)  <=  0.20 

Qnet  (t)  =  QfNf (t)  -  ( 1-phc) *QrNr  ( t ) ; 

end 

%  Calculate  change  in  porosity 

por(t)  =  (por(t-l)  -  Qnet(t))*dt/ 

BMD (t)  =  2*  (1-por  (t) ) ; 

uplim  =  0.99; 
if  por(t)  >=  uplim; 
por(t)  =  uplim; 

end 

end 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

^Format  data  in  charts 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%^%%% 
if  (Pmax  ==  0)&&(tau  ==  5 ) && (area_r_ratio==l ) 
for  t=l: (days+flight+postf light ) 

DataPOal ( t , : )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP0al.txt  DataPOal  -ascii  -double 

end 

if  (Pmax  ==  0.7)&&(tau  ==  5) && (area_r_ratio==l ) 
for  t=l: (days+flight+postf light ) 

DataP07t5al ( t , : )  = 

[TIME(t) ,Df (t) ,Dr (t) ,D(t) ,BMD(t) ] ; 

end 

save  DataPO'/t  5a  1 .  txt  DataPC7t5al  -ascii  -double 

end 


(days+f light+1 ) ) 

Acfdis (t) ) *SA(t) ; 

day 

day 

Tv-Tf ) ) *dt; 
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if  (Pmax  ==  0.7)&&(tau  ==  5) && (area_r_ratio==5 . /6) 
for  t=l: (days+flight+postflight ) 

DataP07t5al2  (t, : )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP07t5al2.txt  DataP07t5al2  -ascii  - 

double 

end 

if  (Pmax  ==  0.7)&&(tau  ==  5) && (area_r_ratio==10  . /13 ) 
for  t=l : (days+flight+postflight) 

DataP07t5al3  (t, : )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP07t5al3.txt  DataP07t5al3  -ascii  - 

double 

end 

if  (Pmax  ==  0.7)&&(tau  ==  20) && (area_r_ratio==l ) 
for  t=l : (days+flight+postflight) 

DataP07t20al  (t,  : )  = 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP07t20al.txt  DataP07t20al  -ascii  - 

double 

end 

if  (Pmax  ==  0.7)&&(tau  ==  20) && (area_r_ratio==5 . /6) 
for  t=l :  (days  +  flight+postflight) 

DataP07t20al2  (t,  : )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP07t20al2.txt  DataP07t20al2  -ascii  - 

double 

end 

if  (Pmax  ==  0.7)&&(tau  == 

20) && (area_r_ratio==10 . /13) 

for  t=l : (days+flight+postflight) 

DataP07t20al3 (t, : )  = 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataP07t20al3.txt  DataP07t20al3  -ascii  - 

double 

end 

if  (Pmax  ==  l)&&(tau  ==  5) &  & (area_r_ratio==l ) 
for  t=l : (days+flight+postflight) 

DataPltSal  (t,  : )  = 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPlt5al.txt  DataPltSal  -ascii  -double 

end 

if  (Pmax  ==  l)&&(tau  ==  5) && (area_r_ratio==5 . /6) 
for  t=l : (days+flight+postflight) 

DataPlt5al2  (t, : )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPlt5al2.txt  DataPlt5al2  -ascii  -double 

end 

if  (Pmax  ==  l)&&(tau  ==  5) && (area_r_ratio==10 . /13) 
for  t=l: (days+flight+postflight) 
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DataPlt5al3 ( t , : )  = 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPltbal3.txt  DataPltbal3  -ascii  -double 

end 

if  (Pmax  ==  l)&&(tau  ==  20 ) &  & (area_r_ratio==l ) 
for  t=l: (days+flight+postf light ) 

DataPlt20al ( t , ; )  = 

[TIME(t)  ,Df  (t)  ,Dr  (t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPlt20ai.txt  DataPit20al  -ascii  -double 

end 

if  (Pmax  ==  l)&&(tau  ==  20) && (area_r_ratio==5 . /6) 
for  t=l:  (days  +  flight+postf light ) 

DataPl t20al2 ( t , : )  ^ 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPlt20al2.txt  DataPlt20ai2  -ascii  - 

double 

end 

if  (Pmax  ==  l)&&(tau  ==  20) && (area_r_ratio==10 . /13) 
for  t=l: (days+flight+postf light ) 

DataPl t2 0al3 ( t , : )  = 

[TIME(t)  ,Df  (t)  ,Dr(t)  ,D(t)  ,BMD(t)  ]  ; 

end 

save  DataPlt20al3.txt  DataPit2Cal3  -ascii  - 

double 

end 

%%%%%'!■%%%%%%%%%%%%%%%%%%%%% 

%End  of  formating  data  in  charts 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

end 

end 

end 
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APPENDIX  B:  FIGURES  (10-DAY  SPACEFLIGHT) 


Figure  Bl.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  10-day 
spaceflight. 
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Figure  B2.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  10-day  spaceflight. 
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Figure  B3.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  10-day 
spaceflight. 
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Figure  B4.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  10-day  spaceflight. 
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Figure  B5.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B6.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B7.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B8.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B9.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  BIO.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B1 1.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B12.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B13.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B14.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B15.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B16.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B17.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 
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Figure  B18.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 


67 


4 


Return  to  Earth 


Figure  B19.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  10-day  spaceflight. 


Figure  B20.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B21.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  10-day  spaceflight. 


Figure  B22.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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Figure  B23.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  10-day  spaceflight. 


Figure  B24,  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  10-day  spaceflight. 
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APPENDIX  C:  FIGURES  (90-DAY  SPACEFLIGHT) 


Figure  Cl.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  90-day 
spaceflight. 
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Figure  C2.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  90-day  spaceflight. 
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re  C3.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  90-day 
spaceflight. 


Figure  C4.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  90-day  spaceflight. 
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Figure  C5.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 
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Figure  C6.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  Cl.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 
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Figure  C8.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C9.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 
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Figure  CIO.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  Cll.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 


Figure  Cl 2.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C13.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 
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Figure  C14.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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re  CIS.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BIMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 


Figure  C16.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 


78 


Figure  Cl 7.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 
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Figure  CIS.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C19.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  90-day  spaceflight. 


Figure  C20.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C21.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C22.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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Figure  C23.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  90-day  spaceflight. 


Figure  C24.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  90-day  spaceflight. 
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APPENDIX  D:  FIGURES  (180-DAY  SPACEFLIGHT) 
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Figure  Dl.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  180- 
day  spaceflight. 


Figure  D2.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  180-day  spaceflight. 
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Figure  D3.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  180- 
day  spaceflight. 


Figure  D4.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  180-day  spaceflight. 
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Figure  D5.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


5.5 

45 

5.5 

2.5 

1.5 
0.5 
*0.5 
-1.5 
-2.5 
-3  5 
^.5 
-5.5 
-6.5 
-7,5 
-6,5 

-as 

-10.5 
-11.5 
-12  5 
-13  5 


Time  (day) 


♦  No  Bisphosphonates 
A  P1t5a12 

•  P1t20a12 
-P07t5a12 
AP07t20a12 


Figure  D6.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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D7.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D8.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D9.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 
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Figure  DIO.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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ire  Dll.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D12.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D13.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D14.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D15.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D16.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D17.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D18.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D19.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  180-day  spaceflight. 


Figure  D20.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D21.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  180-day  spaceflight. 


Figure  D22.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 
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Figure  D23.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  180-day  spaceflight. 


Figure  D24.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  180-day  spaceflight. 


94 


Damage  Rate  (mm/square  mm/day) 


4.50E-05  ^ 


■  Formation 

■  Removal 


Bisphosphonate  Therapy  Given  at  Beginning  of  180-Day  Spaceflight 


Figure  D25.  Predicted  effects  of  180-day  spaceflight  with  and  without  bisphosphonate  treatment  on 
damage  formation  and  removal  rates.  Note  that  these  are  end-of-flight  values. 
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APPENDIX  E:  FIGURES  (365-DAY  SPACEFLIGHT) 
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Figure  El.  Predicted  bisphosphonate  effects  on  BIV1D  and  posttreatment  return  to  Earth  from  365- 
day  spaceflight. 
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Figure  E2.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  365-day  spaceflight. 
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Figure  E3.  Predicted  bisphosphonate  effects  on  BMD  and  posttreatment  return  to  Earth  from  365- 
day  spaceflight. 


Figure  E4.  Predicted  bisphosphonate  effects  on  damage  accumulation  (D)  and  posttreatment  return 
to  Earth  from  365-day  spaceflight. 
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re  E5.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 
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Figure  E6.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E7.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  E8.  Predicted  bisphosphonate  effects  beginning  7  days  preflight  on  damage  accumulation  (D) 
and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E9.  Predicted  bisphosphonate  effeets  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 
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Figure  ElO.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  Ell.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  E12.  Predicted  bisphosphonate  effects  beginning  14  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E13.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  E14.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 


102 


Return  to  Earth 


£ 

a 

X 

m 


-5.5 


Time  (day) 


♦  No  Bisphosphonates 
xP1t5a13 
+  P1t20a13 
P07t5a13 
xP07t20a13 


Figure  El 5.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  E16.  Predicted  bisphosphonate  effects  beginning  30  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E17.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  El 8.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  El 9.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  BMD  and  posttreatment 
return  to  Earth  from  365-day  spaceflight. 


Figure  E20.  Predicted  bisphosphonate  effects  beginning  90  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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re  E21.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E22.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E23.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  BMD  and 
posttreatment  return  to  Earth  from  365-day  spaceflight. 
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Figure  E24.  Predicted  bisphosphonate  effects  beginning  180  days  preflight  on  damage  accumulation 
(D)  and  posttreatment  return  to  Earth  from  365-day  spaceflight. 


107 


